-- Logs begin at Thu 2021-08-19 08:40:35 UTC, end at Thu 2021-08-19 09:48:23 UTC. -- Aug 19 09:09:18.208008 dv-cinder-773876-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 19 09:09:18.215252 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 19 09:09:18.218107 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 19 09:09:18 2021] *** Aug 19 09:09:18.218107 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 09:09:18.218107 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 09:09:18.218107 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: nodename: dv-cinder-773876-3-iscsi Aug 19 09:09:18.218107 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: machine: x86_64 Aug 19 09:09:18.218107 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: clock source: unix Aug 19 09:09:18.218107 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: pcre jit disabled Aug 19 09:09:18.218107 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: detected number of CPU cores: 4 Aug 19 09:09:18.218107 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: current working directory: / Aug 19 09:09:18.218107 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: detected binary path: /usr/bin/uwsgi-core Aug 19 09:09:18.218765 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: your processes number limit is 47680 Aug 19 09:09:18.218765 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: your memory page size is 4096 bytes Aug 19 09:09:18.218765 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: detected max file descriptor number: 2048 Aug 19 09:09:18.218765 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: lock engine: pthread robust mutexes Aug 19 09:09:18.218765 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: thunder lock: enabled Aug 19 09:09:18.218765 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 19 09:09:18.218765 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 19 09:09:18.264216 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: Python main interpreter initialized at 0x559ef0c309c0 Aug 19 09:09:18.264216 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: python threads support enabled Aug 19 09:09:18.264216 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: your server socket listen backlog is limited to 100 connections Aug 19 09:09:18.264216 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: your mercy for graceful operations on workers is 90 seconds Aug 19 09:09:18.264575 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 09:09:18.264653 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: *** Operational MODE: preforking *** Aug 19 09:09:18.264921 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: *** uWSGI is running in multiple interpreter mode *** Aug 19 09:09:18.264921 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: spawned uWSGI master process (pid: 93010) Aug 19 09:09:18.265118 dv-cinder-773876-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 19 09:09:18.265873 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: spawned uWSGI worker 1 (pid: 93011, cores: 1) Aug 19 09:09:18.266053 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: spawned uWSGI worker 2 (pid: 93012, cores: 1) Aug 19 09:09:18.266162 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 09:09:19.899502 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 09:09:19.899502 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: from cryptography.utils import int_from_bytes Aug 19 09:09:19.900153 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 09:09:19.900153 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: from cryptography.utils import int_from_bytes Aug 19 09:09:19.900981 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 09:09:19.900981 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: from cryptography.utils import int_from_bytes Aug 19 09:09:19.901456 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 09:09:19.901456 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: from cryptography.utils import int_from_bytes Aug 19 09:09:22.531680 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 09:09:22.532181 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 09:09:22.532401 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 09:09:22.532758 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 09:09:22.533013 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 09:09:22.533391 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.533712 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.534026 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.534214 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 09:09:22.534564 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.534644 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 09:09:22.534733 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.534929 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 09:09:22.535020 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.535240 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.535365 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 09:09:22.535561 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 09:09:22.535647 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.535893 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.535984 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.536151 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.536249 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.536459 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.536580 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.536779 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773876-3-iscsi {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.536912 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.537093 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.537192 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.537393 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.537486 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.537694 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.537780 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.538005 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.538090 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.538303 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.538393 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.538617 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.538702 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.538916 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.539003 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.539255 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773876-3-iscsi {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.539438 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.539595 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.539886 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.540008 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.540188 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.540289 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.540492 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.540582 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.540793 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.540889 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.541111 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.541200 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.541410 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.541507 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.541721 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.541910 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.542011 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.542222 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.542341 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.542526 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.542624 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.542837 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.542998 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773876-3-iscsi {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.543178 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.543307 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.543630 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.543936 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.544346 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.544683 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.544988 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.545303 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.545436 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.545626 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.545719 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.545927 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.546023 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.546247 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.546332 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.546559 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.546643 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.546872 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.547185 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.547506 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.547786 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.547890 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.548101 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.548223 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773876-3-iscsi {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.548413 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.548545 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.548714 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.548827 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.549014 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.549103 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.549259 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.549518 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.549606 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.549863 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.550175 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.550493 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.550740 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.551003 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.551318 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.551636 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.551937 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.552301 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.552397 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.552646 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.552734 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.552948 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.553036 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.553262 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.553397 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.553559 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.553664 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.553857 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.553967 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.554157 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.554331 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.554471 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.554619 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.554780 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.554948 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.555094 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.555420 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.555734 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.556125 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.556374 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.556655 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.556756 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.556991 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.557115 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.557320 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.557421 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.557603 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.557703 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.557917 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.558003 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.558231 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.558315 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.558485 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.558579 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.558799 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.558892 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.559102 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.559193 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.559439 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.559530 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.559759 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.559853 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.560600 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.560900 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.561230 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.561559 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.561646 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.561837 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.561928 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.562148 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.562242 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.562455 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.562541 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.562761 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.562844 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.563068 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.563153 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.563399 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.563498 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.563700 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.563796 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.563997 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.564092 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.564301 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.564392 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.564604 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.564692 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.564905 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.565000 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.565208 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.565293 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.565509 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.565595 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.565808 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.565903 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.566109 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.566241 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.566411 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.566513 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.566727 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.566822 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.567027 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.567112 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.567375 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.567504 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.567681 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.567777 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.567979 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.568064 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.568277 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.568370 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.568578 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.568661 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.568879 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.568970 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.569179 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.569273 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.569477 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.569560 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.569791 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.569880 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.570039 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.570130 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.570337 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.570420 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.570640 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.570723 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.570957 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.571053 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.571257 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.571402 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.571578 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.571659 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.571870 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.571966 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.572168 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.572251 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.572472 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.572555 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.572770 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.572853 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.573071 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.573153 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.573369 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.573450 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.573666 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.573766 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.573965 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.574060 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.574259 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.574365 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.574554 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.574646 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.574850 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.574933 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.575144 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.575229 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.575490 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.575668 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.576374 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.576501 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.576684 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.576814 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.576990 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.577122 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.577291 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.577429 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.577611 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.577734 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.577943 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.578034 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.578271 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.578358 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.578608 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.578702 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.578920 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.579013 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.579222 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.579329 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.579585 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.579682 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.579899 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.579985 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.580214 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.580323 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.580525 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.580628 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.580822 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.580932 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.581130 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.581223 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.581438 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.581577 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.581740 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.581843 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.582045 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.582132 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.582348 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.582436 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.582649 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.582735 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.582951 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.583037 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.583254 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.583383 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.583582 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.583724 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.583886 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.583987 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.584183 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.584272 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.584500 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.584600 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.584812 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.584898 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.585115 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.585206 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.585420 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.585506 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.585728 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.585832 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.586044 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:09:22.586130 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.586370 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.586453 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.586679 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.586773 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.587001 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.587097 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.587329 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.587431 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.587643 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.587766 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.587953 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.588068 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.588266 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.588360 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.588576 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.588678 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.588884 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.588977 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.589205 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.589306 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.589513 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.589615 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.589821 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.589914 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.590120 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.590219 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.590426 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.590824 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.590990 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.591095 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.591360 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.591449 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.591680 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.591830 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.592084 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.592171 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.592407 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.592492 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.592719 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.592814 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.593037 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.593125 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.593366 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.593452 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.593679 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.593814 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.593987 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.594095 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.594287 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.594383 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.594598 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.594698 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.594906 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.594996 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.595212 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.595327 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.595563 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.595729 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.595867 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.596002 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.596146 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.596294 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.596468 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.596613 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.596778 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.596925 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.597082 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.597231 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.597396 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.597550 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.597706 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.597837 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.597996 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.598092 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.598308 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.598408 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.598627 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.598722 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.598931 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.599025 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.599237 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.599373 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.599566 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.599660 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.599877 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.599972 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.600183 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.600268 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.600502 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.600595 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.600824 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.600911 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.601131 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.601217 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.601431 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.601516 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.601740 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.601830 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.602042 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.602129 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.602342 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.602435 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.602642 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.602728 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.602946 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.603031 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.603246 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.603409 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.603569 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.603656 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.603875 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.603975 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.604175 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.604262 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.604475 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.604572 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.604797 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.604897 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.605100 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.605199 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.605396 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.605481 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.605695 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.605780 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.605994 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.606158 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.606310 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.606402 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.606622 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.606710 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.606987 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.607086 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.607343 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.607435 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.607660 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.607746 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.607981 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.608077 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.608291 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.608391 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.608605 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.608712 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.608909 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.608997 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.609218 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.609303 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.609525 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.609611 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.609834 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.609922 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.610148 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.610233 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.610454 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.610541 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.610758 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.610851 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.611065 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.611150 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.611398 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.611490 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.611707 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.611810 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.612013 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.612102 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.612313 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.612399 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.612616 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.612703 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.612922 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.613014 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.613243 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.613338 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.613550 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.613636 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.613871 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.614008 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.614156 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.614251 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.614456 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.614540 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.614759 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.614899 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.615065 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.615164 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.615392 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.615484 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.615698 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.615784 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.616010 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.616110 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.616313 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.616399 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.616628 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.616713 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.616942 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.617036 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.617261 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.617354 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.617565 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.617651 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.617874 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.617959 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.618172 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.618268 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.618481 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.618567 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.618790 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.618879 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.619110 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.619196 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.619444 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.619532 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.619760 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.619856 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.620069 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.620162 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.620372 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.620458 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.620678 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.620772 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.620984 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.621070 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.621285 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.621378 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.621585 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.621673 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.621891 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.621977 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.622201 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.622296 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.623094 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.623202 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.623482 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.623574 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.623787 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.623887 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.624099 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.624185 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.624405 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.624497 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.624706 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.624801 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.625005 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.625092 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.625311 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.625403 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.625628 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.625727 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.625936 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.626022 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.626252 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.626339 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.626569 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.626657 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.626872 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.626958 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.627172 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.627265 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.627517 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.627607 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.627822 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.627907 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.628125 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.628252 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.628425 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.628521 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.628726 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.628820 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.629064 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.629149 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.629371 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.629458 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.629672 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.629759 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.629982 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.630068 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.630290 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.630377 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.630592 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.630677 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.630900 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.630997 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.631203 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.631308 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.631531 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.631618 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.631840 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.631938 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.632147 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.632234 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.632447 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.632532 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.632752 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.632851 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.633055 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.633140 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.633359 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.633445 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.633667 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.633762 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.633985 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.634071 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.634288 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.634394 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.634594 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.634688 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.634900 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.634987 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.635201 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.635338 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.635530 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.635618 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.635839 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.635931 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.636151 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.636411 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.636506 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.636742 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.636830 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.637044 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.637136 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.637362 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.637456 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.637679 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.637771 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.637986 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.638073 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.638852 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.639040 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.639176 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.639474 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.639564 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.639790 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.639890 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.640096 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.640188 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.640399 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.640486 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.640700 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.640794 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.641006 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.641092 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.641306 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.641393 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.641605 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.641700 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.641905 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.641994 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.642208 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.642294 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.642507 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.642605 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.642806 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.642897 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.643115 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.643200 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.643440 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.643594 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.643749 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.643869 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.644051 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.644197 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.644862 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.645040 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.645210 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.645336 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.645336 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.645528 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.645528 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.645788 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.645894 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.646003 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.646114 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.646247 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.647112 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.647493 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.647493 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.647928 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.647928 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.647928 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.648126 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.648201 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.648267 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.648497 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.648589 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.648732 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.649003 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.649345 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.649703 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.650028 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.650213 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.650303 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.650518 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.650612 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.650823 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.650911 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.651125 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.651211 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.651459 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.651551 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.651767 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.651856 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.652073 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.652159 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.652379 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.652467 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.652681 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.652769 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.652987 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.653073 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.653287 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.653375 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.653595 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.653686 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.653920 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.654054 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.654220 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.654520 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.654605 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.654825 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.654921 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.655127 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.655213 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.655449 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.655539 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.655753 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.655846 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.656050 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.656135 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.656360 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.656455 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.656661 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.656747 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.656961 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.657057 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.657259 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.657352 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.657568 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.657654 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.657871 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.657965 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.658171 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.658256 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.658488 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.658573 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.658794 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.658888 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.659098 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.659218 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.659493 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.659611 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.659740 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.659835 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.660024 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.660120 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.660328 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.660412 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.660645 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.660740 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.660958 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.661042 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.661260 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.661351 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.661568 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.661655 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.661870 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.661953 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.662171 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.662255 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.662472 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.662557 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.662776 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.662866 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.663078 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.663159 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.663399 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.663498 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.663701 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.663785 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.664001 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.664084 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.664302 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.664387 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.664605 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.664694 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.664910 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.665000 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.665209 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.665293 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.665510 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.665593 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.665809 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.665900 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.666118 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.666208 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.666425 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.666510 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.666760 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.666851 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.667054 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.667154 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.667391 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.667478 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.667699 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.667799 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.668005 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.668094 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.668313 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.668396 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.668616 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.668707 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.668915 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.669005 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.669225 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.669346 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.669604 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.669827 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.669906 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.669970 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.670162 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.670353 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.670448 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.670662 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.670745 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.670983 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.671069 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.671310 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.671411 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.671625 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.671709 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.671947 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.672031 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.672268 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.672360 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.672571 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.672652 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.672877 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.672960 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.673181 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.673273 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.673482 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.673564 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.673784 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.673867 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.674085 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.674175 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.674389 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.674473 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.674693 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.674783 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.674999 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.675083 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.675329 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.675412 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.675635 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.675718 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.675941 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.676026 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.676245 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.676328 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.676588 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.676670 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.676893 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.676976 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.677193 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.677275 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.677520 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.677613 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.677829 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.677913 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.678130 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.678213 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.678438 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.678534 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.678742 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.678831 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.679050 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.679134 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.679375 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.679474 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.679696 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.679804 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.680009 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.680113 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.680321 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.680413 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.680627 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.680717 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.680933 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.681023 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.681252 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.681344 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.681562 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.681647 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.681873 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.681963 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.682184 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.682274 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.682501 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.682603 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.682826 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.682918 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.683131 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.683216 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.683465 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.683550 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.683774 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.683856 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.684081 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.684166 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.684391 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.684474 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.684699 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.684781 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.685532 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.685629 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.685837 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.686070 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.686152 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.686391 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.686485 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.686708 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.686798 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.687019 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.687103 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.687356 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.687468 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.687671 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.687787 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.687983 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.688094 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.688289 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.688512 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.688607 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.688822 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.688908 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.689131 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.689224 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.689453 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.689537 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.689775 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.689904 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.690092 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.690188 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.690394 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.690476 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.690707 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.690822 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.691014 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.691136 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.691355 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.691476 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.691678 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.691770 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.691988 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.692073 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.692299 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.692382 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.692603 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.692687 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.692921 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.693006 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.693241 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.693323 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.693551 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.693693 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.693871 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.694006 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.694285 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.694374 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.694606 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.694703 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.694911 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.695001 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.695217 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.695343 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.695552 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.695652 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.695854 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.695936 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.696159 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.696242 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.696463 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.696553 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.696762 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.696844 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.697065 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.697147 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.697373 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.697464 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.697677 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.697760 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.697985 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.698098 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.698294 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.698416 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.698599 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.698725 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.698901 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.699143 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.699236 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.699479 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.699601 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.699790 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.699925 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.700112 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.700223 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.700424 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.700517 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.701294 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.701420 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.701615 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.701736 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.701919 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.702085 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.702240 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.702332 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.702544 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.702657 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.702844 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.702984 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.703142 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.703327 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.703471 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.703649 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.703810 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.703958 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.704114 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.704287 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.704430 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.704613 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.704755 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.704927 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.705082 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.705252 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.705390 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.705676 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.705770 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.706006 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.706096 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.706321 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.706405 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.706631 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.706721 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.706953 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.707036 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.707256 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.707383 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.707578 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.707671 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.707888 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.707972 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.708187 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.708270 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.708487 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.708582 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.708788 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.708872 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.709092 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.709175 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.709393 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.709485 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.709696 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.709786 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.709996 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.710086 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.710302 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.710385 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.710602 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.710684 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.710920 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.711004 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.711223 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.711338 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.711549 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.711631 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.711851 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.711951 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.712151 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.712236 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.712491 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.712581 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.712791 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.712873 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.713111 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.713202 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.713420 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.713504 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.713725 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.713817 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.714028 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.714111 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.714334 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.714417 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.714650 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.714742 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.714964 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.715047 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.715306 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.715393 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.715859 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.715958 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.716193 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.716293 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.716515 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.716701 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.716848 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.717175 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.717271 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.717489 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.717572 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.717803 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.717896 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.718117 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.718200 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.718426 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.718508 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.718733 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.718824 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.719043 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.719260 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.719366 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.719623 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.719718 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.719937 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.720032 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.720250 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.720342 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.720553 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.720637 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.720861 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.720946 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.721164 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.721247 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.721468 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.721560 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.721777 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.721861 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.722086 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.722169 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.722391 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.722482 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.722692 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.722776 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.722999 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.723082 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.723330 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.723436 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.723675 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.723759 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.723979 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.724062 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.724288 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.724380 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.724602 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.724686 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.724920 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.725004 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.725245 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.725335 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.725556 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.725641 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.725870 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.725959 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.726183 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.726273 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.726496 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.726580 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.726808 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.726892 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.727118 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.727202 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.727456 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.727542 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.727770 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.727867 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.728083 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.728166 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.728391 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.728474 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.728697 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.728793 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.729005 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.729088 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.729319 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.729401 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.729639 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.729849 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.729987 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.730187 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.730331 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.730508 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.730676 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.730825 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.730917 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.731140 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.731230 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.731487 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.731688 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.731817 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.732128 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.732219 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.732447 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.732560 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.732759 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.732868 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.733073 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.733161 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.733401 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.733488 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.733716 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.733810 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.734042 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.734135 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.734344 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.734443 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.734647 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.734735 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.734954 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.735040 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.735258 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.735390 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.735581 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.735669 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.735900 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.735986 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.736205 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.736293 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.736506 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.736599 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.736820 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.736907 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.737128 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.737217 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.737500 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.737658 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.737816 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.738009 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.738131 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.738324 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.738446 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.738646 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.738764 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.738967 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.739066 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.739296 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.739388 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.739609 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.739707 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.739930 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.740034 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.740237 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.740334 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.740554 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.740657 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.740853 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.740950 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.741163 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.741249 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.741465 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.741552 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.741767 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.741855 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.742072 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.742353 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.742440 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.742664 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.742759 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.742970 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.743057 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.743287 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.743377 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.743609 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.743698 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.743910 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.743997 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.744210 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.744298 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.744511 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.744600 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.744816 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.744909 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.745117 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.745203 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.745417 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.745512 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.745718 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.745804 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.746016 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.746105 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.746322 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.746409 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.746622 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.746715 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.746927 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.747013 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.747229 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.747339 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.748157 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.748258 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.748446 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.748708 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.748797 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.749040 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.749125 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.749360 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.749483 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.749662 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.749751 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.749961 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.750048 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.750273 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.750370 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.750580 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.750677 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.750908 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.751080 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.751215 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.751420 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.751550 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.751732 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.751869 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.752075 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.752184 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.752391 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.752481 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.752783 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.752920 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.753094 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.753248 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.753403 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.753582 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.753707 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.753919 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.754007 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.754253 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.754348 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.754557 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.754643 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.754860 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.754945 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.755161 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.755260 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.755505 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.755592 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.755815 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.755902 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.756121 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.756208 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.756426 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.756519 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.756730 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.756816 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.757032 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.757119 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.757333 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.757418 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.757636 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.757722 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.757939 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.758026 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.758243 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.758328 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.758546 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.758631 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.758849 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.758935 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.759159 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.759245 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.759489 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.759576 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.759813 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.759901 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.760120 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.760206 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.760424 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.760580 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.760730 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.760817 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.761036 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.761135 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.761340 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.761533 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.761651 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.761851 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.761975 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.762166 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.762287 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.762516 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.762608 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.762837 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.762987 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.763458 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.763579 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.763776 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.763864 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.764095 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.764181 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.764403 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.764499 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.764729 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.764819 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.765063 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.765149 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.765366 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.765464 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.765672 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.765760 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.765985 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.766070 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.766289 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.766456 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.766592 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.766702 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.766898 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.767023 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.767208 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.767312 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.767542 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.767629 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.767853 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.767949 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.768163 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.768257 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.768473 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.768560 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.768777 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.768872 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.769084 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.769172 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.769403 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.769490 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.769715 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.769803 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.770025 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.770113 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.770337 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.770429 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.770646 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.770761 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.770983 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.771084 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.771256 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.771384 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.771584 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.771685 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.771890 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.771978 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.772194 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.772281 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.772516 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.772614 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.772826 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.772914 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.773126 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.773238 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.773447 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.773550 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.773759 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.773847 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.774075 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.774162 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.774387 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.774476 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.774693 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.774804 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.775016 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.775103 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.775350 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.775453 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.775664 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.775751 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.775971 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.776057 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.776277 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.776365 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.776603 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.776689 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.776915 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.777012 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.777222 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.777317 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.777545 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.777631 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.777859 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.777954 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.778183 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.778270 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.778492 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.778585 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.779380 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.779557 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.779686 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.779781 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.780011 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.780099 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.780335 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.780431 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 09:09:22.780653 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.780965 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.781300 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.781608 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.781920 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.782230 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.782541 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.782851 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.783161 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.783517 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.783843 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.784148 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.784473 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.784788 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.785108 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.785422 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.785736 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.786065 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.786374 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.786700 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.787011 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.787346 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.787663 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.787979 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.788306 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.788633 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.788959 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.789286 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.789630 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.789942 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.790285 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.790614 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:09:22.790856 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 09:09:22.802516 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG oslo_db.sqlalchemy.engines [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:09:22.813207 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_db.sqlalchemy.engines [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:09:22.879318 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.context [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),56a64298-a3a4-4bdc-9512-dd1b74decc78(cell1) {{(pid=93012) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 09:09:22.883437 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG oslo_concurrency.lockutils [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:09:22.885014 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG oslo_concurrency.lockutils [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:09:22.885798 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG oslo_concurrency.lockutils [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:09:22.887714 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG oslo_concurrency.lockutils [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:09:22.890993 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.context [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),56a64298-a3a4-4bdc-9512-dd1b74decc78(cell1) {{(pid=93011) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 09:09:22.895204 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:09:22.896797 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:09:22.897609 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:09:22.898266 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG oslo_db.sqlalchemy.engines [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:09:22.899581 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:09:22.900879 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG oslo_db.sqlalchemy.engines [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:09:22.911497 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_db.sqlalchemy.engines [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:09:22.914634 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_db.sqlalchemy.engines [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:09:23.264107 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG oslo_db.sqlalchemy.engines [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:09:23.278430 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_db.sqlalchemy.engines [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:09:23.606619 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: WARNING keystonemiddleware.auth_token [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 09:09:23.613142 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: WARNING keystonemiddleware.auth_token [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 09:09:23.617880 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: WARNING keystonemiddleware.auth_token [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 09:09:23.624955 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: WARNING keystonemiddleware.auth_token [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 09:09:23.956073 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: WARNING keystonemiddleware.auth_token [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 09:09:23.961275 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: WARNING keystonemiddleware.auth_token [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 09:09:23.966972 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559ef0c309c0 pid: 93012 (default app) Aug 19 09:09:23.969241 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:09:23.970439 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: WARNING keystonemiddleware.auth_token [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 09:09:23.970550 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001807 Aug 19 09:09:23.971375 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 789 bytes} [Thu Aug 19 09:09:23 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:09:23.975895 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: WARNING keystonemiddleware.auth_token [None req-71f7da2a-6cad-4675-848c-37546ce1b15a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 09:09:23.981180 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559ef0c309c0 pid: 93011 (default app) Aug 19 09:10:43.685983 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:10:43.686987 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 19 09:10:43.687424 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 2/2] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:10:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:10:44.111560 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-10877afe-77e8-4a68-acff-0d595b173098 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:10:44.140795 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-10877afe-77e8-4a68-acff-0d595b173098 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.446024 Aug 19 09:10:44.141654 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 1/3] 10.222.0.32 () {60 vars in 1292 bytes} [Thu Aug 19 09:10:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:10:46.355073 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:10:46.356210 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-91bf8ae9-2861-4326-bcc3-7e0136cb3425 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Aug 19 09:10:46.359601 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 3/4] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:10:46 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:10:46.418616 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-abce958a-486f-4e10-8a12-74188776363e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1}} {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:10:46.437446 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:10:46.437446 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: warnings.warn(msg) Aug 19 09:10:46.467544 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-abce958a-486f-4e10-8a12-74188776363e admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104496 Aug 19 09:10:46.468421 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 2/5] 10.222.0.32 () {64 vars in 1283 bytes} [Thu Aug 19 09:10:46 2021] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:10:46.688542 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-27d13eab-4874-49c8-a88e-9f9ee4a0c571 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:10:46.690864 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:10:46.690864 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: warnings.warn(msg) Aug 19 09:10:46.741893 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-27d13eab-4874-49c8-a88e-9f9ee4a0c571 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.265115 Aug 19 09:10:46.742679 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 4/6] 10.222.0.32 () {64 vars in 1336 bytes} [Thu Aug 19 09:10:46 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:10:49.058914 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-abce958a-486f-4e10-8a12-74188776363e admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:10:49.059968 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-abce958a-486f-4e10-8a12-74188776363e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 19 09:10:49.060385 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 3/7] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:10:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:10:49.166297 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-21120578-3d69-456f-a291-a61ee107b8ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "swap": 0, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:10:49.184139 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:10:49.184139 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: warnings.warn(msg) Aug 19 09:10:49.203053 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-21120578-3d69-456f-a291-a61ee107b8ba admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136197 Aug 19 09:10:49.203788 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 5/8] 10.222.0.32 () {64 vars in 1283 bytes} [Thu Aug 19 09:10:49 2021] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:10:49.217389 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-b0a60d92-dd25-4df4-81b8-dee0cb3e5145 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:10:49.218992 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:10:49.218992 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: warnings.warn(msg) Aug 19 09:10:49.264150 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-b0a60d92-dd25-4df4-81b8-dee0cb3e5145 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050530 Aug 19 09:10:49.264978 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 4/9] 10.222.0.32 () {64 vars in 1336 bytes} [Thu Aug 19 09:10:49 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:10:51.444822 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-21120578-3d69-456f-a291-a61ee107b8ba admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:10:51.445840 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-21120578-3d69-456f-a291-a61ee107b8ba admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 19 09:10:51.446261 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 6/10] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:10:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:10:51.512708 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-43b21c47-c7f4-4a6c-9d76-0958608898d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2"}} {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:10:51.531875 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-43b21c47-c7f4-4a6c-9d76-0958608898d1 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078485 Aug 19 09:10:51.535350 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 5/11] 10.222.0.32 () {64 vars in 1283 bytes} [Thu Aug 19 09:10:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:10:51.546032 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-42621a7e-cebf-47f8-bca1-c2f46151e7dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:10:51.569960 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-42621a7e-cebf-47f8-bca1-c2f46151e7dc admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028198 Aug 19 09:10:51.570688 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 7/12] 10.222.0.32 () {64 vars in 1336 bytes} [Thu Aug 19 09:10:51 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:10:53.749307 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-43b21c47-c7f4-4a6c-9d76-0958608898d1 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:10:53.750464 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-43b21c47-c7f4-4a6c-9d76-0958608898d1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Aug 19 09:10:53.751048 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 6/13] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:10:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:10:53.813072 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-867f9a42-4bab-4d22-9f80-f3c98f769546 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "ram": 2048, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:10:53.835050 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-867f9a42-4bab-4d22-9f80-f3c98f769546 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077470 Aug 19 09:10:53.836210 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 8/14] 10.222.0.32 () {64 vars in 1283 bytes} [Thu Aug 19 09:10:53 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:10:53.848818 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-fa544cec-1005-4dba-a90d-4daac69f8f1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:10:53.873938 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-fa544cec-1005-4dba-a90d-4daac69f8f1e admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029478 Aug 19 09:10:53.874555 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 7/15] 10.222.0.32 () {64 vars in 1336 bytes} [Thu Aug 19 09:10:53 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:10:56.055900 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-867f9a42-4bab-4d22-9f80-f3c98f769546 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:10:56.056929 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-867f9a42-4bab-4d22-9f80-f3c98f769546 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 19 09:10:56.057337 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 9/16] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:10:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:10:56.119986 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-31268fe8-d159-4d70-b68c-29f9cde0f6d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:10:56.139429 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-31268fe8-d159-4d70-b68c-29f9cde0f6d1 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075678 Aug 19 09:10:56.140287 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 8/17] 10.222.0.32 () {64 vars in 1283 bytes} [Thu Aug 19 09:10:56 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:10:56.152593 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-facd75ce-0007-4b14-a5b8-e3f3bb4b378a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:10:56.173808 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-facd75ce-0007-4b14-a5b8-e3f3bb4b378a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025419 Aug 19 09:10:56.174547 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 10/18] 10.222.0.32 () {64 vars in 1336 bytes} [Thu Aug 19 09:10:56 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:10:58.338427 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-31268fe8-d159-4d70-b68c-29f9cde0f6d1 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:10:58.339519 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-31268fe8-d159-4d70-b68c-29f9cde0f6d1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002298 Aug 19 09:10:58.340177 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 9/19] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:10:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:10:58.407059 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-284dc65e-60a5-4955-aa8a-bc68ea388377 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:10:58.431509 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-284dc65e-60a5-4955-aa8a-bc68ea388377 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084873 Aug 19 09:10:58.437001 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 11/20] 10.222.0.32 () {60 vars in 1292 bytes} [Thu Aug 19 09:10:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:11:00.589426 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-31268fe8-d159-4d70-b68c-29f9cde0f6d1 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:00.590686 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-31268fe8-d159-4d70-b68c-29f9cde0f6d1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001696 Aug 19 09:11:00.591095 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 10/21] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:11:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:11:00.652877 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-29327e1e-a37c-41e0-96c1-c9a6033d2598 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:00.674791 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-29327e1e-a37c-41e0-96c1-c9a6033d2598 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077104 Aug 19 09:11:00.675503 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 12/22] 10.222.0.32 () {64 vars in 1283 bytes} [Thu Aug 19 09:11:00 2021] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:11:00.690732 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-8a3b3780-5126-4d70-9381-451d7561bb69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:00.718006 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-8a3b3780-5126-4d70-9381-451d7561bb69 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031984 Aug 19 09:11:00.718610 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 11/23] 10.222.0.32 () {64 vars in 1333 bytes} [Thu Aug 19 09:11:00 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:11:02.960738 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-29327e1e-a37c-41e0-96c1-c9a6033d2598 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:02.961780 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-29327e1e-a37c-41e0-96c1-c9a6033d2598 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 19 09:11:02.962646 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 13/24] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:11:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:11:03.025587 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-044b67d7-3f08-4f1b-b6ed-d96bac43cec1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "disk": 20}} {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:03.044526 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-044b67d7-3f08-4f1b-b6ed-d96bac43cec1 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075501 Aug 19 09:11:03.045108 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 12/25] 10.222.0.32 () {64 vars in 1283 bytes} [Thu Aug 19 09:11:02 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:11:03.057534 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-6c594e84-5a1e-403e-8d5f-f8cb4d6e1c91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:03.079148 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-6c594e84-5a1e-403e-8d5f-f8cb4d6e1c91 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025274 Aug 19 09:11:03.079749 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 14/26] 10.222.0.32 () {64 vars in 1333 bytes} [Thu Aug 19 09:11:03 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:11:05.562630 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-044b67d7-3f08-4f1b-b6ed-d96bac43cec1 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:05.563707 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-044b67d7-3f08-4f1b-b6ed-d96bac43cec1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 19 09:11:05.564142 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 13/27] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:11:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:11:05.623949 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-8cfdbf1f-14d7-40bd-abca-14692bc61f2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:05.642854 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-8cfdbf1f-14d7-40bd-abca-14692bc61f2c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071385 Aug 19 09:11:05.643347 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 15/28] 10.222.0.32 () {64 vars in 1283 bytes} [Thu Aug 19 09:11:05 2021] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:11:05.656213 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-9b9ea395-aafa-4398-81be-8e6265813c7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:05.681874 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-9b9ea395-aafa-4398-81be-8e6265813c7a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029577 Aug 19 09:11:05.682486 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 14/29] 10.222.0.32 () {64 vars in 1333 bytes} [Thu Aug 19 09:11:05 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:11:07.841064 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-8cfdbf1f-14d7-40bd-abca-14692bc61f2c admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:07.842085 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-8cfdbf1f-14d7-40bd-abca-14692bc61f2c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 19 09:11:07.842486 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 16/30] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:11:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:11:07.905976 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-4f0629f5-a751-4e45-a764-1ba1a46586bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "name": "m1.large", "ram": 8192, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:07.923802 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-4f0629f5-a751-4e45-a764-1ba1a46586bd admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074953 Aug 19 09:11:07.924360 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 15/31] 10.222.0.32 () {64 vars in 1283 bytes} [Thu Aug 19 09:11:07 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:11:07.936622 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-63b7d513-c10e-4c1a-9581-fa185ee1c64e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:07.959591 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-63b7d513-c10e-4c1a-9581-fa185ee1c64e admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026519 Aug 19 09:11:07.960258 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 17/32] 10.222.0.32 () {64 vars in 1333 bytes} [Thu Aug 19 09:11:07 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:11:10.140911 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-4f0629f5-a751-4e45-a764-1ba1a46586bd admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:10.143047 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-4f0629f5-a751-4e45-a764-1ba1a46586bd admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003193 Aug 19 09:11:10.143684 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 16/33] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:11:10 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:11:10.239784 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-8048a9e9-e659-4f20-bdc4-52f49c777b30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "swap": 0, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:10.261860 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-8048a9e9-e659-4f20-bdc4-52f49c777b30 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.111361 Aug 19 09:11:10.262674 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 18/34] 10.222.0.32 () {64 vars in 1283 bytes} [Thu Aug 19 09:11:10 2021] POST /compute/v2.1/flavors => generated 408 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:11:10.274667 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-e0a34c77-6bf3-4c0b-ad97-e46132457961 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:10.298969 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-e0a34c77-6bf3-4c0b-ad97-e46132457961 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027979 Aug 19 09:11:10.303752 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 17/35] 10.222.0.32 () {64 vars in 1333 bytes} [Thu Aug 19 09:11:10 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:11:50.774486 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-8048a9e9-e659-4f20-bdc4-52f49c777b30 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:50.775525 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-8048a9e9-e659-4f20-bdc4-52f49c777b30 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Aug 19 09:11:50.775925 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 19/36] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:11:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:11:50.833873 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-c9d5fcd3-41f3-4c26-a4d6-342d52c31eea admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:50.850351 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-c9d5fcd3-41f3-4c26-a4d6-342d52c31eea admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068007 Aug 19 09:11:50.850910 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 18/37] 10.222.0.32 () {60 vars in 1292 bytes} [Thu Aug 19 09:11:50 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:11:52.256080 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-8048a9e9-e659-4f20-bdc4-52f49c777b30 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:52.257950 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-8048a9e9-e659-4f20-bdc4-52f49c777b30 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 19 09:11:52.258355 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 20/38] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:11:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:11:52.446806 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-af833700-18e8-4fb8-8a15-ae4b3addf5ce admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:52.452127 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.wsgi [None req-af833700-18e8-4fb8-8a15-ae4b3addf5ce admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 19 09:11:52.452690 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-af833700-18e8-4fb8-8a15-ae4b3addf5ce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:11:52.453477 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-af833700-18e8-4fb8-8a15-ae4b3addf5ce admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.057936 Aug 19 09:11:52.453978 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 19/39] 10.222.0.32 () {60 vars in 1191 bytes} [Thu Aug 19 09:11:52 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 09:11:52.463819 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-86a650d0-6e44-4b48-8760-7f553434e25b admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:52.484599 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-86a650d0-6e44-4b48-8760-7f553434e25b admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024439 Aug 19 09:11:52.485092 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 21/40] 10.222.0.32 () {60 vars in 1211 bytes} [Thu Aug 19 09:11:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:11:52.495688 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-6ebb6b9c-37a1-4ae5-be69-8b8435ba2405 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:52.516685 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-6ebb6b9c-37a1-4ae5-be69-8b8435ba2405 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025184 Aug 19 09:11:52.517214 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 20/41] 10.222.0.32 () {60 vars in 1211 bytes} [Thu Aug 19 09:11:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:11:52.526917 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-14e00ed2-a37f-4f8f-8d3c-79746f8355af admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:52.532267 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.wsgi [None req-14e00ed2-a37f-4f8f-8d3c-79746f8355af admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 19 09:11:52.532835 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-14e00ed2-a37f-4f8f-8d3c-79746f8355af admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:11:52.533624 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-14e00ed2-a37f-4f8f-8d3c-79746f8355af admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010220 Aug 19 09:11:52.534106 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 22/42] 10.222.0.32 () {60 vars in 1191 bytes} [Thu Aug 19 09:11:52 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 09:11:53.907829 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-6ebb6b9c-37a1-4ae5-be69-8b8435ba2405 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:53.908845 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-6ebb6b9c-37a1-4ae5-be69-8b8435ba2405 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 19 09:11:53.909244 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 21/43] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:11:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:11:54.099982 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-7833ded0-39da-4194-983e-01da1ccbb342 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:54.105235 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.wsgi [None req-7833ded0-39da-4194-983e-01da1ccbb342 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 19 09:11:54.105801 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-7833ded0-39da-4194-983e-01da1ccbb342 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:11:54.106591 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-7833ded0-39da-4194-983e-01da1ccbb342 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.060127 Aug 19 09:11:54.107112 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 23/44] 10.222.0.32 () {60 vars in 1191 bytes} [Thu Aug 19 09:11:54 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 09:11:54.117273 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-9695c727-1265-494f-9e31-54eeab032751 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:54.130181 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-9695c727-1265-494f-9e31-54eeab032751 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017039 Aug 19 09:11:54.130736 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 22/45] 10.222.0.32 () {60 vars in 1211 bytes} [Thu Aug 19 09:11:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:11:54.140927 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-14057af7-006c-433e-a870-b02667948759 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:54.154145 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-14057af7-006c-433e-a870-b02667948759 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016600 Aug 19 09:11:54.154655 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 24/46] 10.222.0.32 () {60 vars in 1211 bytes} [Thu Aug 19 09:11:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:11:54.164707 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-396c6dd7-8616-4f03-bdd4-06eaf1a0ee1c admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:54.169652 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.wsgi [None req-396c6dd7-8616-4f03-bdd4-06eaf1a0ee1c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 19 09:11:54.170212 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-396c6dd7-8616-4f03-bdd4-06eaf1a0ee1c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:11:54.170997 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-396c6dd7-8616-4f03-bdd4-06eaf1a0ee1c admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010214 Aug 19 09:11:54.171515 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 23/47] 10.222.0.32 () {60 vars in 1191 bytes} [Thu Aug 19 09:11:54 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 19 09:11:55.508828 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-14057af7-006c-433e-a870-b02667948759 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:55.509831 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-14057af7-006c-433e-a870-b02667948759 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Aug 19 09:11:55.510228 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 25/48] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:11:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:11:55.702177 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-eefb5bb9-9384-4df1-90af-d015d11e04ab admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:55.708047 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.wsgi [None req-eefb5bb9-9384-4df1-90af-d015d11e04ab admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 19 09:11:55.708616 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-eefb5bb9-9384-4df1-90af-d015d11e04ab admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:11:55.709402 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-eefb5bb9-9384-4df1-90af-d015d11e04ab admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.058132 Aug 19 09:11:55.710325 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 24/49] 10.222.0.32 () {60 vars in 1194 bytes} [Thu Aug 19 09:11:55 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 09:11:55.720168 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-f2e7ed34-7427-4c8b-a3db-2827bbe6c723 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:55.734327 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-f2e7ed34-7427-4c8b-a3db-2827bbe6c723 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017665 Aug 19 09:11:55.734842 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 26/50] 10.222.0.32 () {60 vars in 1211 bytes} [Thu Aug 19 09:11:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:11:55.744918 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:55.759253 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018328 Aug 19 09:11:55.759794 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 25/51] 10.222.0.32 () {60 vars in 1211 bytes} [Thu Aug 19 09:11:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:11:55.769530 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-9f5899e9-f5e8-4ea1-a10a-8198d39ef0e0 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:55.774915 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.wsgi [None req-9f5899e9-f5e8-4ea1-a10a-8198d39ef0e0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 19 09:11:55.775524 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-9f5899e9-f5e8-4ea1-a10a-8198d39ef0e0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:11:55.776313 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-9f5899e9-f5e8-4ea1-a10a-8198d39ef0e0 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010309 Aug 19 09:11:55.776799 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 27/52] 10.222.0.32 () {60 vars in 1194 bytes} [Thu Aug 19 09:11:55 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 19 09:11:57.109877 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:57.110879 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 19 09:11:57.111300 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 26/53] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:11:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:11:57.299583 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-da5b4f09-6b19-4516-90ff-bc2cacb70013 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:57.316761 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-da5b4f09-6b19-4516-90ff-bc2cacb70013 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.068800 Aug 19 09:11:57.317284 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 28/54] 10.222.0.32 () {64 vars in 1236 bytes} [Thu Aug 19 09:11:57 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:11:58.704921 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:11:58.705929 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 19 09:11:58.706326 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 27/55] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:11:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:11:58.905833 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-c4573f3f-2efd-41e9-97c3-5a25847793a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:11:58.923678 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-c4573f3f-2efd-41e9-97c3-5a25847793a0 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.068234 Aug 19 09:11:58.924145 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 29/56] 10.222.0.32 () {64 vars in 1236 bytes} [Thu Aug 19 09:11:58 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:12:00.264479 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:12:00.265480 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Aug 19 09:12:00.265878 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 28/57] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:12:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:12:00.457047 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-b0947a84-30f8-4658-bafe-b706ea2fdccf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:12:00.474464 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-b0947a84-30f8-4658-bafe-b706ea2fdccf admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.069322 Aug 19 09:12:00.474962 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 30/58] 10.222.0.32 () {64 vars in 1236 bytes} [Thu Aug 19 09:12:00 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:12:01.830336 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:12:01.831371 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 19 09:12:01.831779 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 29/59] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:12:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:12:02.027899 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-396838e3-cf72-4376-b866-489ca08549cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:12:02.045572 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-396838e3-cf72-4376-b866-489ca08549cb admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.070293 Aug 19 09:12:02.046045 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 31/60] 10.222.0.32 () {64 vars in 1236 bytes} [Thu Aug 19 09:12:01 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:12:03.371523 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:12:03.372560 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 19 09:12:03.372955 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 30/61] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:12:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:12:03.563756 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-95dd7bfb-0577-48ed-ba62-e5ad7a1a8488 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:12:03.583210 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-95dd7bfb-0577-48ed-ba62-e5ad7a1a8488 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.071472 Aug 19 09:12:03.583697 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 32/62] 10.222.0.32 () {60 vars in 1203 bytes} [Thu Aug 19 09:12:03 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:12:47.702750 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:12:47.703787 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-9da6c2f8-c9bd-4234-be9d-ae4b0c46e9a5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 19 09:12:47.704181 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 31/63] 10.222.0.32 () {54 vars in 931 bytes} [Thu Aug 19 09:12:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:12:47.762034 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-3eccb302-30be-4f63-bc6e-4ae49c36d8b3 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:12:47.781110 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-3eccb302-30be-4f63-bc6e-4ae49c36d8b3 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070624 Aug 19 09:12:47.781632 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 33/64] 10.222.0.32 () {60 vars in 1292 bytes} [Thu Aug 19 09:12:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:12:47.803432 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-6bdd222a-41b3-4d2e-808c-1bb3688c50ea admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:12:47.810877 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-6bdd222a-41b3-4d2e-808c-1bb3688c50ea admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010951 Aug 19 09:12:47.811427 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 32/65] 10.222.0.32 () {60 vars in 1283 bytes} [Thu Aug 19 09:12:47 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:12:47.822561 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-1764065f-12a8-43dd-a477-a2dc91570457 admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:12:47.829896 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-1764065f-12a8-43dd-a477-a2dc91570457 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010931 Aug 19 09:12:47.830391 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 34/66] 10.222.0.32 () {60 vars in 1286 bytes} [Thu Aug 19 09:12:47 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:12:47.842181 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-185b74f3-4851-4be6-acf9-30ee39d983e6 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:12:47.849413 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-185b74f3-4851-4be6-acf9-30ee39d983e6 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010831 Aug 19 09:12:47.849916 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 33/67] 10.222.0.32 () {60 vars in 1286 bytes} [Thu Aug 19 09:12:47 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:12:47.861203 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-9d42c50b-32bc-41bc-a8dd-2b4f18037e9b admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:12:47.868395 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-9d42c50b-32bc-41bc-a8dd-2b4f18037e9b admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010476 Aug 19 09:12:47.868894 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 35/68] 10.222.0.32 () {60 vars in 1283 bytes} [Thu Aug 19 09:12:47 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:14:05.467316 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-48b4af0c-7b66-4fd9-be55-3143c6fb648b tempest-verify_tempest_config-922432979 tempest-verify_tempest_config-922432979-project] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:14:05.469538 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-48b4af0c-7b66-4fd9-be55-3143c6fb648b tempest-verify_tempest_config-922432979 tempest-verify_tempest_config-922432979-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108111 Aug 19 09:14:05.470079 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 34/69] 10.222.0.32 () {58 vars in 1134 bytes} [Thu Aug 19 09:14:05 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:15:29.092947 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-9d42c50b-32bc-41bc-a8dd-2b4f18037e9b admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:15:29.093957 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-9d42c50b-32bc-41bc-a8dd-2b4f18037e9b admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 19 09:15:29.094353 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 36/70] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:15:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:15:29.348203 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-a5c45d13-3952-49c8-a0ef-e8439fecee1b admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:15:29.349346 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:15:29.349346 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: warnings.warn(msg) Aug 19 09:15:29.350864 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-a5c45d13-3952-49c8-a0ef-e8439fecee1b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:15:29.351324 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-a5c45d13-3952-49c8-a0ef-e8439fecee1b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:15:29.352110 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-a5c45d13-3952-49c8-a0ef-e8439fecee1b admin admin] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:15:29.352565 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-a5c45d13-3952-49c8-a0ef-e8439fecee1b admin admin] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:15:29.386035 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-a5c45d13-3952-49c8-a0ef-e8439fecee1b admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.149346 Aug 19 09:15:29.386592 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 35/71] 10.222.0.32 () {60 vars in 1194 bytes} [Thu Aug 19 09:15:29 2021] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:15:30.736925 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-9d42c50b-32bc-41bc-a8dd-2b4f18037e9b admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:15:30.737917 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-9d42c50b-32bc-41bc-a8dd-2b4f18037e9b admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Aug 19 09:15:30.738309 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 37/72] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:15:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:15:30.926980 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-5daa4a34-1aef-45eb-a089-c3d688fdeac6 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:15:30.928139 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:15:30.928139 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: warnings.warn(msg) Aug 19 09:15:30.929642 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-5daa4a34-1aef-45eb-a089-c3d688fdeac6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:15:30.930078 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-5daa4a34-1aef-45eb-a089-c3d688fdeac6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:15:30.930924 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-5daa4a34-1aef-45eb-a089-c3d688fdeac6 admin admin] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:15:30.931366 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-5daa4a34-1aef-45eb-a089-c3d688fdeac6 admin admin] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:15:30.951501 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-5daa4a34-1aef-45eb-a089-c3d688fdeac6 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.074485 Aug 19 09:15:30.951985 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 36/73] 10.222.0.32 () {60 vars in 1194 bytes} [Thu Aug 19 09:15:30 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:15:42.716012 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-9d42c50b-32bc-41bc-a8dd-2b4f18037e9b admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:15:42.717013 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-9d42c50b-32bc-41bc-a8dd-2b4f18037e9b admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 19 09:15:42.717411 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 38/74] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:15:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:15:42.909191 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-7e5a8ef0-69bc-45bb-93a5-2073b40afeec admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:15:42.910321 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:15:42.910321 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: warnings.warn(msg) Aug 19 09:15:42.912132 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-7e5a8ef0-69bc-45bb-93a5-2073b40afeec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:15:42.912570 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-7e5a8ef0-69bc-45bb-93a5-2073b40afeec admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:15:42.913350 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-7e5a8ef0-69bc-45bb-93a5-2073b40afeec admin admin] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:15:42.913800 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-7e5a8ef0-69bc-45bb-93a5-2073b40afeec admin admin] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:15:42.937752 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-7e5a8ef0-69bc-45bb-93a5-2073b40afeec admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.080841 Aug 19 09:15:42.938239 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 37/75] 10.222.0.32 () {60 vars in 1194 bytes} [Thu Aug 19 09:15:42 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:15:44.330462 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: DEBUG nova.api.openstack.wsgi [None req-9d42c50b-32bc-41bc-a8dd-2b4f18037e9b admin admin] Calling method '>' {{(pid=93012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:15:44.331485 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: INFO nova.api.openstack.requestlog [None req-9d42c50b-32bc-41bc-a8dd-2b4f18037e9b admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Aug 19 09:15:44.331879 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: [pid: 93012|app: 0|req: 39/76] 10.222.0.32 () {56 vars in 1075 bytes} [Thu Aug 19 09:15:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:15:44.521298 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG nova.api.openstack.wsgi [None req-934efc8a-ace5-412a-9fa3-bbe8777d8fd5 admin admin] Calling method '>' {{(pid=93011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:15:44.522455 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:15:44.522455 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: warnings.warn(msg) Aug 19 09:15:44.523996 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-934efc8a-ace5-412a-9fa3-bbe8777d8fd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:15:44.524443 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-934efc8a-ace5-412a-9fa3-bbe8777d8fd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:15:44.525264 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-934efc8a-ace5-412a-9fa3-bbe8777d8fd5 admin admin] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:15:44.526344 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: DEBUG oslo_concurrency.lockutils [None req-934efc8a-ace5-412a-9fa3-bbe8777d8fd5 admin admin] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:15:44.547734 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: INFO nova.api.openstack.requestlog [None req-934efc8a-ace5-412a-9fa3-bbe8777d8fd5 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.077236 Aug 19 09:15:44.548280 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: [pid: 93011|app: 0|req: 38/77] 10.222.0.32 () {60 vars in 1194 bytes} [Thu Aug 19 09:15:44 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:16:40.660337 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: Thu Aug 19 09:16:40 2021 - graceful shutdown triggered... Aug 19 09:16:40.660455 dv-cinder-773876-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 19 09:16:40.661379 dv-cinder-773876-3-iscsi devstack@n-api.service[93011]: Gracefully killing worker 1 (pid: 93011)... Aug 19 09:16:40.662029 dv-cinder-773876-3-iscsi devstack@n-api.service[93012]: Gracefully killing worker 2 (pid: 93012)... Aug 19 09:16:41.662448 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: worker 1 buried after 1 seconds Aug 19 09:16:41.662979 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: worker 2 buried after 1 seconds Aug 19 09:16:41.662979 dv-cinder-773876-3-iscsi devstack@n-api.service[93010]: goodbye to uWSGI. Aug 19 09:16:41.664007 dv-cinder-773876-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 19 09:16:41.664572 dv-cinder-773876-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 19 09:16:41.667468 dv-cinder-773876-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 19 09:16:41.676772 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 19 09:16:41.679314 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 19 09:16:41 2021] *** Aug 19 09:16:41.679471 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 09:16:41.679600 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 09:16:41.679711 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: nodename: dv-cinder-773876-3-iscsi Aug 19 09:16:41.679819 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: machine: x86_64 Aug 19 09:16:41.679943 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: clock source: unix Aug 19 09:16:41.680052 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: pcre jit disabled Aug 19 09:16:41.680158 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: detected number of CPU cores: 4 Aug 19 09:16:41.680288 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: current working directory: / Aug 19 09:16:41.680288 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: detected binary path: /usr/bin/uwsgi-core Aug 19 09:16:41.680288 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: your processes number limit is 47680 Aug 19 09:16:41.680288 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: your memory page size is 4096 bytes Aug 19 09:16:41.680288 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: detected max file descriptor number: 2048 Aug 19 09:16:41.680288 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: lock engine: pthread robust mutexes Aug 19 09:16:41.680721 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: thunder lock: enabled Aug 19 09:16:41.680721 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 19 09:16:41.680721 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 19 09:16:41.725357 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: Python main interpreter initialized at 0x5594dfd229c0 Aug 19 09:16:41.725711 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: python threads support enabled Aug 19 09:16:41.725889 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: your server socket listen backlog is limited to 100 connections Aug 19 09:16:41.726056 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: your mercy for graceful operations on workers is 90 seconds Aug 19 09:16:41.726556 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 09:16:41.726836 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: *** Operational MODE: preforking *** Aug 19 09:16:41.727676 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: *** uWSGI is running in multiple interpreter mode *** Aug 19 09:16:41.727859 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: spawned uWSGI master process (pid: 107934) Aug 19 09:16:41.728238 dv-cinder-773876-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 19 09:16:41.729998 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: spawned uWSGI worker 1 (pid: 107957, cores: 1) Aug 19 09:16:41.730538 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: spawned uWSGI worker 2 (pid: 107958, cores: 1) Aug 19 09:16:41.730859 dv-cinder-773876-3-iscsi devstack@n-api.service[107934]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 09:16:43.541355 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 09:16:43.541355 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: from cryptography.utils import int_from_bytes Aug 19 09:16:43.541997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 09:16:43.541997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: from cryptography.utils import int_from_bytes Aug 19 09:16:43.611485 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 09:16:43.611485 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: from cryptography.utils import int_from_bytes Aug 19 09:16:43.612144 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 09:16:43.612144 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: from cryptography.utils import int_from_bytes Aug 19 09:16:46.060035 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 09:16:46.060575 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 09:16:46.061357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 09:16:46.061658 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 09:16:46.061917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 09:16:46.062306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.062638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.062964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.063373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.063646 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.063960 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.064333 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.064607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.064940 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.065205 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.065525 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.065853 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773876-3-iscsi {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.066185 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.066500 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.066818 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.067142 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.067487 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.067814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.068125 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.068665 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.069101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.069418 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.069735 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.070287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.070613 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.070922 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.071249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.071596 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.071930 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.072243 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.072645 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773876-3-iscsi {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.072970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.073288 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.073607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.074397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.074397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.074866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.074985 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.075325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.075641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.075974 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.076331 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.077324 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.077510 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.077817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.078126 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.078440 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.078762 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.079071 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.079403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.079661 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.079973 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.080301 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.080627 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.080955 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.081213 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.081474 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.081797 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.082122 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.082436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.082747 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.083060 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.083396 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.083710 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.084022 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.084334 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.084643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.084964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.085334 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.085606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.085919 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.086245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.086655 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.086911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.087225 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.087598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.087923 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.088238 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.088562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.088887 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.089200 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.089513 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.089825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.090150 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.090478 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.090788 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.091044 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.091372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.091686 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.092542 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.092889 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.093293 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.093609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.093918 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.094230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.094546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.094859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.095171 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.095508 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.095819 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.096129 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.096445 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.096754 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.097342 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.097669 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.098017 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.098287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.098598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.098908 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.099234 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.099641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.099955 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.100282 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.100596 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.100907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.101227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.101541 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.101854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.102177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.102482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.102794 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.103929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.103929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.103929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.104171 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.104335 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.105144 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.105144 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.105301 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.105696 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.105826 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.106164 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.106475 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.106790 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.107118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.107449 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.108360 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.108772 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.109115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.109466 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.109788 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.110136 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.110474 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.110802 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.111122 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.111468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.111803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.112123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.112444 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.112763 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.113089 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.113415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.113751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.114075 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.114399 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.114723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.115041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.115388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.115724 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.116054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.116378 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.116725 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.117070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.117389 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.117719 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.118036 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.118396 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.118680 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.118997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.119338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.119665 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.119984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.120303 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.120643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.120967 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.121287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.121597 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.121911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.122222 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.122537 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.122848 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.123176 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.123626 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.123944 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.124283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.124596 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.124912 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.125230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.125541 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.125857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.126179 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.126491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.126818 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.127135 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.127474 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.127800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.128883 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.128883 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.128883 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.129344 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.129344 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.129619 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.129939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.130256 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.130570 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.130931 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.131244 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.135917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.136343 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.136415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.136705 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.137016 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.137337 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.137669 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.137981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.138329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.138671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.139657 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.140007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.140401 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.140728 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.141051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.141372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.141692 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.142012 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.142339 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.142659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.142986 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.143317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.143652 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.143970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.144299 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.144615 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.144939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.145285 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.145623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.145949 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.146380 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.146625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.146914 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.147231 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.147576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.147893 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.148211 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.148536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.148858 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.149180 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.149498 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.149826 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.150142 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.150467 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.150777 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.151112 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.151453 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.151792 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.152109 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.152426 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.152752 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.153068 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.153386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.153702 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.154013 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.154324 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.155258 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.155882 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.156186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.156519 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.156839 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.157165 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.157489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.157801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.158116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.158439 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.158771 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.159095 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.159448 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.159780 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.160093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.160405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.160737 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.161054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.161367 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.161663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.162010 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.162320 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.162641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.162949 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.163349 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.163640 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.163959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.164281 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.164597 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.164914 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.165242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.165561 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.165879 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.166201 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.166516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.166830 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.167146 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.167581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.167814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.168131 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.168447 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.168756 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.169119 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.169394 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.169979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.170414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.171898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.171898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.171898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.171898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.172981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.172981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.172981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.172981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.173528 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.173686 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.174183 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.174183 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.174493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.174798 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.175113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.175456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.175771 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.176093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.176416 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.176729 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.177055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.177371 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.177691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.178007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.178340 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.178658 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.178974 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.179306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.179644 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.179996 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.180312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.180659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.180995 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.181347 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.181663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.181976 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.182305 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.182620 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.182933 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.183245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.183589 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.183905 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.184216 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.184533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.184852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.185174 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.185489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.185825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.186149 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.186461 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.186785 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.187105 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.187459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.187774 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.188174 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.188605 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.188709 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.189024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.189337 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.189661 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.189970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.190286 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.190599 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.190917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.191649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.191649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.191940 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.192194 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.192504 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.192822 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.193133 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.193444 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.193762 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.194093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.194415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.194728 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.195046 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.195392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.195707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.196023 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.196338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.196648 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.196958 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.197272 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.197582 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.197891 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.198219 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.198536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.198846 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.199157 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.199495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.199846 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.200158 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.200587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.200843 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.201166 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.202018 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.202341 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.202662 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.202984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.203325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.203657 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.203975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.204297 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.204610 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.204921 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.205251 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.205571 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.205895 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.206223 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.206551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.206882 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.207205 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.207526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.207837 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.208158 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.208472 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.208791 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.209107 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.209425 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.209787 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.210055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.210539 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.211023 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.211533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.212021 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.212487 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.212981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.213500 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.213995 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.214507 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.215046 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.215451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.215653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.216593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.216786 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.217751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.218166 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.218641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.218985 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.219369 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.219667 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.219987 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.220421 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.220769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.221063 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.221336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 09:16:46.221800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.222162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 09:16:46.222248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.222475 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.222576 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 09:16:46.222660 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.222732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 09:16:46.222953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.223056 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 09:16:46.223287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.223521 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.223623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.223736 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.223913 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.224275 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.224598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.224723 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.224929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.225350 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.225466 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.226098 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.226098 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.226392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.226688 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.226804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.227005 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.227116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.227365 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.227479 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.227696 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.227896 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.228089 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.228188 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.228296 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.228418 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.228649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.228969 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.229094 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.229317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.229419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773876-3-iscsi {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.229613 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.229832 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.229922 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.230011 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.230364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.230462 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.230543 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.230615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.230933 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.231111 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.231258 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.231442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.231587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.231741 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.231938 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.232122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.232334 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.232482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.233138 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.233403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.233794 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.233991 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.234143 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.234323 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.234481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.234637 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.234791 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.234955 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.235182 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.235389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.235548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.235703 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.235857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.236243 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.236503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.236662 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.236816 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.236994 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.237273 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.237273 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.237584 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773876-3-iscsi {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.237731 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.237886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.238031 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.238177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.238321 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.238465 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.238623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.238897 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.239141 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.239313 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.239477 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.239648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.239803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.239803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.240144 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.240296 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.240483 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.240631 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.240846 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.241011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.241253 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.241411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.241565 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.241711 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.241877 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.242025 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.242169 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.242313 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.242458 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.242612 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.242763 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.242916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.243069 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.243213 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.243388 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.243554 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.243713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.243876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.244021 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.244021 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.244369 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.244561 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.244717 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.244863 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.245006 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.245168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.245386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.245555 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.245706 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.245864 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.246038 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.246339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.246524 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.246745 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.246895 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.247042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.247195 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.247388 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.247551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.250514 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.250706 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.250880 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.251042 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.251203 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.251482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.251650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.251798 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.251953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.252107 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.252272 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.252425 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.252571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.252723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.252723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.252723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.253165 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.253362 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.253518 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.253663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.253836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.253985 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.254140 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.254325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.254473 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.254617 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.254617 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.254920 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.254920 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.255196 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.255413 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.255654 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.255654 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.255952 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.255952 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.256255 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.256255 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.256732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.256962 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.257129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.257287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.257441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.257586 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.257744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.258050 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.258338 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.258505 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.258653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.258806 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.259057 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.259328 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.259484 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.259630 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.259797 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.259797 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.260073 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.260228 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.260634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.260818 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.260970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.261116 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.261271 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.261432 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.261432 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.261862 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.262093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.262361 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.262513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.262670 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.262825 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.262978 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.263123 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.263363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.263564 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.263746 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.264571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.264915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.265085 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.265283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.265283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.265896 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.266049 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.266204 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.266350 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.266515 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.266854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.267109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.267287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.267443 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.267443 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.267768 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.268011 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.268172 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.268326 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.268482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.268482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.268482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.268482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.268482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.268482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.268482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.269451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.269451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.269451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.269921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.270101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.270253 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.271199 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.271429 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.271594 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.271907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.272108 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.272266 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.272419 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.272566 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.272723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.272951 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.273099 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.273244 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.273387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.273531 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.273695 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.273695 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.274054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.274212 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.274356 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.274500 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.274657 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.274813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.274960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.274960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.274960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.274960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.274960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.274960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.274960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.276038 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.276190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.276190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.276476 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.276633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.276940 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.277121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.277338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.277503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.277649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.277802 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.277990 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.278174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.278323 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.278482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.278636 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.278788 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.278945 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.279099 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.279244 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.279439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 09:16:46.279661 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.279815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.279961 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.280106 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.280261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.280406 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.280550 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.280702 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.280848 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.281002 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.281410 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.281564 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.281710 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.281855 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.282137 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.282331 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.282493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.282638 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.282792 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.282946 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.283099 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.283264 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.283448 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.283448 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.283448 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.283881 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.284026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.284182 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.284328 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.284490 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.284720 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.284871 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.285024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.285182 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.285350 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.285495 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.285647 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.285800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.285944 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.286226 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.286410 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.286561 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.286706 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.286997 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.287114 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.287217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.287476 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.287641 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.287795 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.287945 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.288106 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.288252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.288404 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.288557 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.288711 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.288866 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.289026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.289180 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.289332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.289489 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.289634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.289785 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.289944 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.289944 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.290271 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.290271 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.290271 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.290271 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.290271 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.290963 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.291107 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.291415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.291667 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.291837 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.291992 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.292163 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.292411 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.292572 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.292727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.292883 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.293029 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.293174 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.293318 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.293477 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.293634 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.293806 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.293952 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.294098 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.294242 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.294418 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.294571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.294725 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.294872 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.295032 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.296086 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.296298 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.296410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.296506 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.296605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.296702 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.296788 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.296788 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.296952 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297041 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297114 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297189 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297260 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297435 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.297593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.298044 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.298044 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.298292 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.298506 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.298678 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.298869 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.299039 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.299233 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.299436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.299606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.299766 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.299919 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.300079 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.300231 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.300390 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.300555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.300709 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.300867 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.301020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.301172 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.301368 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.301598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.301865 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.302026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.302181 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.302333 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.302696 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.302866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.303019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.303180 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.303386 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.303554 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.303729 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.303892 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.304051 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.304204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.304204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.304492 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.304664 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.304820 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.304980 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.305132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.305284 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.305451 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.305603 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.305778 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.305778 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.306065 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.306216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.306502 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.306663 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.306817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.306970 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.307138 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.307458 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.307781 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.307948 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.308112 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.308364 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.308524 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.308676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.308837 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.308997 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.309151 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.309302 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.309462 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.309624 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.309624 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.309921 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.310084 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.310247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.310247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.310544 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.310801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.311605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.311899 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.312206 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.312383 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.312570 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.312808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.312808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.312808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.313355 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.313533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.313703 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.313856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.314014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.314167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.314318 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.314526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.314692 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.314855 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.315015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.315174 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.315356 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.315527 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.315690 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.315853 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.316006 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.316169 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.316322 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.316500 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.316735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.316900 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.317060 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.317212 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.317508 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.317699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.317936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.318095 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.318256 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.318409 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.318571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.318762 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.318926 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.319088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.319248 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.319442 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.319714 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.319871 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.320024 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.320185 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.320185 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.320487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.320649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.320800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.320951 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.321103 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.321253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.321428 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.321599 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.321753 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.321930 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.322171 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.322441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.322648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.322806 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.322958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.323215 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.323409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.323574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.323727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.323878 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.324036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.324203 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.324364 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.324364 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.324676 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.324834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.324985 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325143 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325304 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 09:16:46.325911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.325911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.327137 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.327137 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.327137 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.327781 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.327781 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.328166 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.328332 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.328484 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.328815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.329136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.329454 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.329770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.330474 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.330642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.330856 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.331191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.331548 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.331866 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.332217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.332517 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.332835 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.333149 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.333463 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.333778 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.334130 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.334450 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.334763 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.335097 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.335455 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.335778 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.336102 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.336423 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.336745 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.337078 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.337417 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.337756 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.338022 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.338344 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.338655 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.339584 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.339584 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.339904 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.339904 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.340350 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.340671 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.341094 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.341316 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.342979 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.343315 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.343714 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.343714 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.344158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.344376 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.344694 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.345041 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.345379 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.345705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.346032 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.346365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.346685 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.354770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355063 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_db.sqlalchemy.engines [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:16:46.355174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.355894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.356492 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.356492 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.356492 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.356492 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.356492 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.356492 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.356492 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.356492 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.357093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.357093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.357093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.357093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.357093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.357093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.357578 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.358476 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.358748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.359574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.359907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.360230 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.360711 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.361039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.361371 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.361700 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.362024 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.362346 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.362673 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.363000 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.363340 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.363669 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.363984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.364328 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.364632 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.364948 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.365266 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.365590 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.365918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.366235 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.366574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.366899 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.367216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.367566 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.367884 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.368203 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.368528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.368860 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.369189 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.369504 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.369825 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.370139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.370478 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.370796 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.371115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.371454 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.371769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.372084 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.372398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.372710 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.373042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.374566 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.374899 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.375223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.375569 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.375932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.376254 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.376635 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.377133 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.377518 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.377852 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.378382 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.378921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.379255 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.379601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.379936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.380264 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.380674 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.380907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.381224 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.381583 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.381886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.382211 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.382546 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.382937 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.383214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.383560 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.383885 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.384275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.384527 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.384849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.385261 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.385584 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.385909 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.386637 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.386637 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.386967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.387160 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.387508 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.387830 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.388147 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.388489 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.389439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.390358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.390691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.391014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.391365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.391722 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.392171 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.392496 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.392820 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.393140 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.393464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.393789 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.394118 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.394455 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.394777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.395216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.395570 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.395897 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.396222 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.396542 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.396861 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.397184 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.397527 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.397846 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.398162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.398480 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.398819 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.399139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.399510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.399955 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.400283 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.400602 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.401032 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.401357 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.401679 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.402019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.402355 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.402690 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.403005 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.403362 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.403686 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.404019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.404353 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.406058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.406408 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.406737 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.407081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.407447 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.407784 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.408131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.408580 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.408918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.409247 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.409600 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.409922 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.410246 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.410567 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.410894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.411214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.411559 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.411896 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.412214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.412539 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.412860 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.413182 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.413499 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.413817 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.414151 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.414469 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.414805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.415135 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.415500 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.415833 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.416152 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.416486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.416810 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.417128 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.417446 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.417769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.418127 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.418445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.418778 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.419121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.419503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.419812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.420277 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.420776 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.421235 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.421681 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.422061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.422381 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.422700 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.423028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.423381 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.423704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.424022 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.424345 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.424661 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.424977 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.425294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.425631 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.425937 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.426272 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.426594 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.426911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.427227 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.427619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.427980 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.428296 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.428642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.428976 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.429309 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.429651 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.429970 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.430304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.430630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.430956 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.431313 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.431635 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.431961 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.432287 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.432614 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.432934 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.433261 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.433590 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.433916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.434506 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.434845 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.435169 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.435531 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.436081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.437078 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.437441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.437762 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.438125 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.438493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.438839 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.439225 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.439630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.439975 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.440333 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.440698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.441033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.441361 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.441696 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.442076 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.442409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.442733 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.443062 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.443420 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.443757 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.444086 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.444413 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.444738 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.445068 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.445400 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.445722 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.446148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.446371 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.446713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.447064 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.447418 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.447752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.448077 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.448400 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.448988 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.449314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.449654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.449994 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.450327 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.450708 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.450986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.451922 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.452877 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.453215 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.453549 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.453878 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.454202 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.454541 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.454866 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.455187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.455551 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.455876 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.456477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.456840 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.457171 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.457512 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.457850 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.458198 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.458506 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.458847 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.459166 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.459511 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.459842 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.460168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.460487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.460803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.461129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.461453 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.461769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.462096 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.462412 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.462751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.463070 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.463411 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.463733 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.464057 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.464376 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.464695 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.465015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.465331 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.465659 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.465976 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.466321 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.466616 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.467091 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.468516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.468847 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.469175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.469519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.469846 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.470168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.470504 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.470834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.471414 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.471746 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.472342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.472704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.473038 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.473628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.473974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.474326 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.474689 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.475042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.475386 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.475708 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.476025 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.476369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.476691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.477016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.477340 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.477663 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.477986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.478310 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.478633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.478963 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.479300 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.479628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.479982 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.480312 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.480642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.480970 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.481298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.481621 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.481942 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.482264 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.482632 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.483487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.483844 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.484175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.484497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.484940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.485266 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.485598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.485936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.486262 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.486608 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.486965 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.487324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.487665 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.487984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.488305 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.488625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.488950 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.489298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.489626 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.489961 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.490297 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.490620 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.490947 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.491302 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.491633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.491963 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.492288 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.492659 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.493025 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.493390 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.493718 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.494042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.494365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.494686 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.495026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.495386 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.495705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.496039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.496367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.496699 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.497026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.497344 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.497683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.498001 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.499303 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.499641 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.499971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.500303 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.500640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.500979 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.501319 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.501657 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.501999 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.502360 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.502686 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.503040 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.503403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 09:16:46.503658 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 09:16:46.515965 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.context [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),56a64298-a3a4-4bdc-9512-dd1b74decc78(cell1) {{(pid=107958) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 09:16:46.520320 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:16:46.521888 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:16:46.522685 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:16:46.524663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:16:46.526928 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_db.sqlalchemy.engines [None req-79868971-1490-405a-866f-8de9d226cf20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:16:46.535775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_db.sqlalchemy.engines [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:16:46.536617 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_db.sqlalchemy.engines [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:16:46.699733 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.context [None req-79868971-1490-405a-866f-8de9d226cf20 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),56a64298-a3a4-4bdc-9512-dd1b74decc78(cell1) {{(pid=107957) load_cells /opt/stack/nova/nova/context.py:464}} Aug 19 09:16:46.704695 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79868971-1490-405a-866f-8de9d226cf20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:16:46.706221 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79868971-1490-405a-866f-8de9d226cf20 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:16:46.707025 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79868971-1490-405a-866f-8de9d226cf20 None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:16:46.709010 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79868971-1490-405a-866f-8de9d226cf20 None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:16:46.720155 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_db.sqlalchemy.engines [None req-79868971-1490-405a-866f-8de9d226cf20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:16:46.720994 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_db.sqlalchemy.engines [None req-79868971-1490-405a-866f-8de9d226cf20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:16:46.799898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_db.sqlalchemy.engines [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:16:46.994750 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_db.sqlalchemy.engines [None req-79868971-1490-405a-866f-8de9d226cf20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 09:16:47.125482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: WARNING keystonemiddleware.auth_token [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 09:16:47.131994 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: WARNING keystonemiddleware.auth_token [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 09:16:47.338122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: WARNING keystonemiddleware.auth_token [None req-79868971-1490-405a-866f-8de9d226cf20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 09:16:47.346475 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: WARNING keystonemiddleware.auth_token [None req-79868971-1490-405a-866f-8de9d226cf20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 09:16:47.477924 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: WARNING keystonemiddleware.auth_token [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 09:16:47.483409 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: WARNING keystonemiddleware.auth_token [None req-33539f37-4501-4e2c-b838-b595836a8b2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 09:16:47.488572 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594dfd229c0 pid: 107958 (default app) Aug 19 09:16:47.704834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: WARNING keystonemiddleware.auth_token [None req-79868971-1490-405a-866f-8de9d226cf20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 19 09:16:47.710128 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: WARNING keystonemiddleware.auth_token [None req-79868971-1490-405a-866f-8de9d226cf20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 19 09:16:47.715294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594dfd229c0 pid: 107957 (default app) Aug 19 09:17:20.941651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1002531909", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "networks": [{"uuid": "64ed585a-dafa-4239-9b89-ad18bb66a515"}]}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:21.150768 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-21ccc8d1-f863-4191-b38e-75f7abe844eb tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Action: 'create', calling method: .version_select at 0x7fdb824055e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-114869263", "metadata": {"Type": "work"}}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:21.155129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-21ccc8d1-f863-4191-b38e-75f7abe844eb tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:17:21.156448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-21ccc8d1-f863-4191-b38e-75f7abe844eb tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.897467 Aug 19 09:17:21.161141 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1156 bytes} [Thu Aug 19 09:17:20 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 900 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 09:17:21.268086 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ad437b02-304b-4c98-aa4a-5c89779c26b7 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Action: 'create', calling method: .version_select at 0x7fdb823531f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-122398023"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:21.457329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] validate_networks() for [('64ed585a-dafa-4239-9b89-ad18bb66a515', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:17:21.986536 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ad437b02-304b-4c98-aa4a-5c89779c26b7 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.827922 Aug 19 09:17:21.987301 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 2/2] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Aug 19 09:17:21 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 829 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 19 09:17:21.992375 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d89cbbf9-df9e-45bc-8572-308c71db3342 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Action: 'create', calling method: .version_select at 0x7fdb82405c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1445848452", "metadata": {"Type": "work"}}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:21.995491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d89cbbf9-df9e-45bc-8572-308c71db3342 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:17:21.996836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d89cbbf9-df9e-45bc-8572-308c71db3342 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008250 Aug 19 09:17:21.998714 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 3/3] 10.222.0.32 () {60 vars in 1156 bytes} [Thu Aug 19 09:17:21 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 09:17:22.012705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a0708417-4ecc-4f1c-9fc3-daa5c7664175 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb82253ca0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:22.086614 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a0708417-4ecc-4f1c-9fc3-daa5c7664175 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87" status: 200 len: 344 microversion: 2.1 time: 0.085832 Aug 19 09:17:22.092852 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 4/4] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:17:21 2021] GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:22.093628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-78c83bf6-f516-47ca-8e2a-780e8b81f688 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Action: 'create', calling method: .version_select at 0x7fdb82253af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2005110541", "metadata": {"Type": "work"}}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:22.094862 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-78c83bf6-f516-47ca-8e2a-780e8b81f688 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:17:22.097972 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-78c83bf6-f516-47ca-8e2a-780e8b81f688 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009215 Aug 19 09:17:22.098516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 5/5] 10.222.0.32 () {60 vars in 1156 bytes} [Thu Aug 19 09:17:22 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 09:17:22.120750 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-17188b74-9698-4a71-ae2c-be4948d8e8e6 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Calling method '.version_select at 0x7fdb82405ca0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:22.168417 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-17188b74-9698-4a71-ae2c-be4948d8e8e6 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] HTTP exception thrown: Volume tempest-invalid-766607494 could not be found. Aug 19 09:17:22.171842 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-17188b74-9698-4a71-ae2c-be4948d8e8e6 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Returning 404 to user: Volume tempest-invalid-766607494 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:17:22.172879 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-17188b74-9698-4a71-ae2c-be4948d8e8e6 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-766607494" status: 404 len: 98 microversion: 2.1 time: 0.061256 Aug 19 09:17:22.174807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 6/6] 10.222.0.32 () {58 vars in 1215 bytes} [Thu Aug 19 09:17:22 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-766607494 => generated 98 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 19 09:17:22.189873 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4a092218-6430-4281-8d71-b2d1b8dafbfa tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003531 Aug 19 09:17:22.190374 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 7/7] 10.222.0.32 () {58 vars in 1140 bytes} [Thu Aug 19 09:17:22 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 19 09:17:22.214418 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a69d840f-6211-4f55-9df7-b5d0ad6d05db tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014135 Aug 19 09:17:22.219910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 8/8] 10.222.0.32 () {58 vars in 1137 bytes} [Thu Aug 19 09:17:22 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 19 09:17:22.238151 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d9b3ac36-2629-4529-bd76-87d1e89a6b7f tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Calling method '.version_select at 0x7fdb822538b0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:22.309742 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-d9b3ac36-2629-4529-bd76-87d1e89a6b7f tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] HTTP exception thrown: Volume 82dbeefa-cfe7-4212-ad31-752818f460fd could not be found. Aug 19 09:17:22.311217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d9b3ac36-2629-4529-bd76-87d1e89a6b7f tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Returning 404 to user: Volume 82dbeefa-cfe7-4212-ad31-752818f460fd could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:17:22.312460 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d9b3ac36-2629-4529-bd76-87d1e89a6b7f tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/82dbeefa-cfe7-4212-ad31-752818f460fd" status: 404 len: 109 microversion: 2.1 time: 0.085081 Aug 19 09:17:22.319463 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 9/9] 10.222.0.32 () {58 vars in 1248 bytes} [Thu Aug 19 09:17:22 2021] DELETE /compute/v2.1/os-volumes/82dbeefa-cfe7-4212-ad31-752818f460fd => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 09:17:22.325248 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-45dee9aa-df35-4c0b-addc-8e1f5c68ef32 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Calling method '.version_select at 0x7fdb82405e50>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:22.358511 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-45dee9aa-df35-4c0b-addc-8e1f5c68ef32 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] HTTP exception thrown: Volume 38cf417b-3d33-46d4-b1dd-f3683939a32c could not be found. Aug 19 09:17:22.359359 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-45dee9aa-df35-4c0b-addc-8e1f5c68ef32 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] Returning 404 to user: Volume 38cf417b-3d33-46d4-b1dd-f3683939a32c could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:17:22.361212 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-45dee9aa-df35-4c0b-addc-8e1f5c68ef32 tempest-VolumesNegativeTest-29253111 tempest-VolumesNegativeTest-29253111-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/38cf417b-3d33-46d4-b1dd-f3683939a32c" status: 404 len: 109 microversion: 2.1 time: 0.040256 Aug 19 09:17:22.372195 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 10/10] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:17:22 2021] GET /compute/v2.1/os-volumes/38cf417b-3d33-46d4-b1dd-f3683939a32c => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:17:23.037992 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:17:23.040071 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:17:23.041282 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:17:23.041935 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:17:23.042716 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:17:23.089597 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:23.095986 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:23.097215 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:23.098246 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:23.099673 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cbb01ab3-3dc5-4059-8c83-89016880efb2 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb8226d8b0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:23.173622 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Getting quotas for project 32a1a9a34bd848cd8c97172208bd43ce. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:17:23.187169 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Getting quotas for user 160c4dff902b4c8aa26d9b1e58bd4e89 and project 32a1a9a34bd848cd8c97172208bd43ce. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:17:23.208292 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:17:23.215134 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:17:23.217361 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cbb01ab3-3dc5-4059-8c83-89016880efb2 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87" status: 200 len: 344 microversion: 2.1 time: 0.120805 Aug 19 09:17:23.218246 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 11/11] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:17:23 2021] GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87 => generated 344 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:17:23.424777 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-38b9084c-b43b-4a87-af4f-e9d3b96903b5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.872135 Aug 19 09:17:23.426307 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 1/12] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:17:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 3876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 09:17:23.439156 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8cca4fe4-4276-4d6d-bfe6-98458c63af17 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:23.442064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8cca4fe4-4276-4d6d-bfe6-98458c63af17 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:23.536299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-922445459", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "networks": [{"uuid": "5e78b5e6-6e38-4b51-a3a6-7fec0d074363"}]}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:23.760736 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8cca4fe4-4276-4d6d-bfe6-98458c63af17 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:23.782046 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8cca4fe4-4276-4d6d-bfe6-98458c63af17 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1215 microversion: 2.1 time: 0.349275 Aug 19 09:17:23.783361 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 2/13] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:23 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1215 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:23.795307 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.network.neutron [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] validate_networks() for [('5e78b5e6-6e38-4b51-a3a6-7fec0d074363', None, None, None, None, None)] {{(pid=107957) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:17:23.797681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d4e09fac-c862-4d40-b235-901f604bd5e8 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb82200e50>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:23.923115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d4e09fac-c862-4d40-b235-901f604bd5e8 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/05260281-a138-4a03-a22a-3f66a12dd1ab" status: 200 len: 350 microversion: 2.1 time: 0.138533 Aug 19 09:17:23.923751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 3/14] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:17:23 2021] GET /compute/v2.1/os-volumes/05260281-a138-4a03-a22a-3f66a12dd1ab => generated 350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:24.229899 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-81c056eb-1ab6-4bea-99cb-03fa18bf17f6 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb819adc10>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:24.375198 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-81c056eb-1ab6-4bea-99cb-03fa18bf17f6 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87" status: 200 len: 345 microversion: 2.1 time: 0.148917 Aug 19 09:17:24.375806 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 4/15] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:17:24 2021] GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87 => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:24.394576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f3c55f22-248d-4b6c-a626-ee88c548c690 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Action: 'create', calling method: .version_select at 0x7fdb819145e0>, body: {"snapshot": {"volume_id": "fc392d8a-491e-4568-8d10-c1a4b99c7b87", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1535472181"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:24.940422 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f3c55f22-248d-4b6c-a626-ee88c548c690 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.556737 Aug 19 09:17:24.941254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 5/16] 10.222.0.32 () {60 vars in 1162 bytes} [Thu Aug 19 09:17:24 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:17:24.968622 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-11d50015-831a-4262-9236-39f822479169 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:24.968622 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-11d50015-831a-4262-9236-39f822479169 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:25.129881 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-11d50015-831a-4262-9236-39f822479169 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:25.137105 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-11d50015-831a-4262-9236-39f822479169 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1215 microversion: 2.1 time: 0.194752 Aug 19 09:17:25.140846 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 6/17] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:24 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:25.152768 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-68033586-92bc-4503-a17c-a12515207dd4 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb81914430>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:25.335325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-68033586-92bc-4503-a17c-a12515207dd4 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25" status: 200 len: 287 microversion: 2.1 time: 0.193156 Aug 19 09:17:25.335934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 7/18] 10.222.0.32 () {58 vars in 1251 bytes} [Thu Aug 19 09:17:25 2021] GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25 => generated 287 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:25.346179 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-207cc78a-42a2-44c1-9898-2b912b84a329 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb819165e0>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:25.455511 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-207cc78a-42a2-44c1-9898-2b912b84a329 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.113449 Aug 19 09:17:25.456090 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 8/19] 10.222.0.32 () {58 vars in 1140 bytes} [Thu Aug 19 09:17:25 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:17:25.468179 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-82d1869b-45a7-4477-9721-3482a8c86474 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb81916ca0>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:25.527763 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Flavor limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:17:25.528202 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Image limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:17:25.529547 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Flavor pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:17:25.529547 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Image pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:17:25.530177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:17:25.568956 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:25.570853 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:25.571590 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-82d1869b-45a7-4477-9721-3482a8c86474 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25" status: 200 len: 287 microversion: 2.1 time: 0.108232 Aug 19 09:17:25.572359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 9/20] 10.222.0.32 () {58 vars in 1251 bytes} [Thu Aug 19 09:17:25 2021] GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:17:25.578875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:25.580334 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:25.662583 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Getting quotas for project 8bd62739089241319075c92d0306a0a3. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:17:25.681458 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-52268ddc-2e10-448b-82ec-6fb88c0ad5cf tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb81916310>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:25.682652 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Getting quotas for user bfa387ffa6784561956f39df611dfab4 and project 8bd62739089241319075c92d0306a0a3. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:17:25.696674 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Going to run 1 instances... {{(pid=107957) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:17:25.700084 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:17:25.831310 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-52268ddc-2e10-448b-82ec-6fb88c0ad5cf tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f485386e-cf50-421e-8553-fcace67ece07" status: 200 len: 351 microversion: 2.1 time: 0.153321 Aug 19 09:17:25.832109 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 10/21] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:17:25 2021] GET /compute/v2.1/os-volumes/f485386e-cf50-421e-8553-fcace67ece07 => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:17:25.863537 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-da44ecff-320c-4e3c-b3df-8220b4144060 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.636571 Aug 19 09:17:25.870840 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 12/22] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:17:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 2647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:17:25.876496 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4acf78a4-0fd3-460b-8fca-393fc6358a13 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:25.877276 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4acf78a4-0fd3-460b-8fca-393fc6358a13 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:26.157916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-27a8bcd9-3ba8-4913-a8d3-f02215a04c00 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:26.159197 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-27a8bcd9-3ba8-4913-a8d3-f02215a04c00 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:26.186912 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27a8bcd9-3ba8-4913-a8d3-f02215a04c00 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:26.190776 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27a8bcd9-3ba8-4913-a8d3-f02215a04c00 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:26.194128 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27a8bcd9-3ba8-4913-a8d3-f02215a04c00 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:26.194621 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27a8bcd9-3ba8-4913-a8d3-f02215a04c00 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:26.255754 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4acf78a4-0fd3-460b-8fca-393fc6358a13 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:26.285015 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4acf78a4-0fd3-460b-8fca-393fc6358a13 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1217 microversion: 2.1 time: 0.412896 Aug 19 09:17:26.285920 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 11/23] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:25 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1217 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:17:26.585155 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-fe0ead08-7b54-4b53-9e47-9e3267fa7cc3 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb81914430>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:26.601941 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-27a8bcd9-3ba8-4913-a8d3-f02215a04c00 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:26.647738 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-fe0ead08-7b54-4b53-9e47-9e3267fa7cc3 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25" status: 200 len: 287 microversion: 2.1 time: 0.067009 Aug 19 09:17:26.652259 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 12/24] 10.222.0.32 () {58 vars in 1251 bytes} [Thu Aug 19 09:17:26 2021] GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:26.653496 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-27a8bcd9-3ba8-4913-a8d3-f02215a04c00 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1211 microversion: 2.1 time: 0.491656 Aug 19 09:17:26.658101 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 13/25] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:26 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1211 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:17:27.301558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c4057778-7b13-4fec-a63e-bc801a5fd06c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:27.302169 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c4057778-7b13-4fec-a63e-bc801a5fd06c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:27.312233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c4057778-7b13-4fec-a63e-bc801a5fd06c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:27.312985 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c4057778-7b13-4fec-a63e-bc801a5fd06c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:27.313781 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c4057778-7b13-4fec-a63e-bc801a5fd06c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:27.314221 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c4057778-7b13-4fec-a63e-bc801a5fd06c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:27.555704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c4057778-7b13-4fec-a63e-bc801a5fd06c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:27.586126 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c4057778-7b13-4fec-a63e-bc801a5fd06c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1221 microversion: 2.1 time: 0.280216 Aug 19 09:17:27.587348 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 13/26] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:27 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1221 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:27.660825 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-48a0fae5-3cac-478a-8c8d-580f288e5dd7 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb821e8b80>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:27.673627 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7e29f565-59cd-4a5e-be8e-37fe4d2f35a6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:27.674882 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7e29f565-59cd-4a5e-be8e-37fe4d2f35a6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:27.682558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7e29f565-59cd-4a5e-be8e-37fe4d2f35a6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:27.687947 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7e29f565-59cd-4a5e-be8e-37fe4d2f35a6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:27.689837 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7e29f565-59cd-4a5e-be8e-37fe4d2f35a6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:27.690497 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7e29f565-59cd-4a5e-be8e-37fe4d2f35a6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:27.715190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-48a0fae5-3cac-478a-8c8d-580f288e5dd7 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25" status: 200 len: 287 microversion: 2.1 time: 0.059216 Aug 19 09:17:27.719110 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 14/27] 10.222.0.32 () {58 vars in 1251 bytes} [Thu Aug 19 09:17:27 2021] GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:27.783670 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7e29f565-59cd-4a5e-be8e-37fe4d2f35a6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:27.797122 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7e29f565-59cd-4a5e-be8e-37fe4d2f35a6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1211 microversion: 2.1 time: 0.129447 Aug 19 09:17:27.807806 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 14/28] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:27 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:28.605434 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5c794d95-79be-4ac7-841a-30bae956f19f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:28.606053 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5c794d95-79be-4ac7-841a-30bae956f19f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:28.623467 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c794d95-79be-4ac7-841a-30bae956f19f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:28.623918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c794d95-79be-4ac7-841a-30bae956f19f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:28.624694 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c794d95-79be-4ac7-841a-30bae956f19f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:28.625129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c794d95-79be-4ac7-841a-30bae956f19f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:28.739127 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7c6affd5-7ae3-4cc3-87fd-5fa90783f2cb tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb818bbca0>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:28.819416 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7c6affd5-7ae3-4cc3-87fd-5fa90783f2cb tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25" status: 200 len: 287 microversion: 2.1 time: 0.095417 Aug 19 09:17:28.820100 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 15/29] 10.222.0.32 () {58 vars in 1251 bytes} [Thu Aug 19 09:17:28 2021] GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:28.824763 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-38bafcfd-23a8-4831-bd20-1c210228d3b0 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:28.825383 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-38bafcfd-23a8-4831-bd20-1c210228d3b0 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:28.837893 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38bafcfd-23a8-4831-bd20-1c210228d3b0 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:28.839568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38bafcfd-23a8-4831-bd20-1c210228d3b0 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:28.840396 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38bafcfd-23a8-4831-bd20-1c210228d3b0 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:28.840727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5c794d95-79be-4ac7-841a-30bae956f19f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:28.853736 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38bafcfd-23a8-4831-bd20-1c210228d3b0 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:28.855758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5c794d95-79be-4ac7-841a-30bae956f19f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1221 microversion: 2.1 time: 0.254312 Aug 19 09:17:28.859677 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 15/30] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:28 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1221 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:28.968061 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-38bafcfd-23a8-4831-bd20-1c210228d3b0 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:28.979671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-38bafcfd-23a8-4831-bd20-1c210228d3b0 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1211 microversion: 2.1 time: 0.158389 Aug 19 09:17:28.981060 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 16/31] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:28 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:29.833302 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1c471027-c3ba-4de7-8440-e80cd382f586 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb82162f70>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:29.874974 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b2076bd6-fb4a-43d5-b183-4436c0f449d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:29.875751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b2076bd6-fb4a-43d5-b183-4436c0f449d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:29.881761 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2076bd6-fb4a-43d5-b183-4436c0f449d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:29.888841 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2076bd6-fb4a-43d5-b183-4436c0f449d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:29.890275 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2076bd6-fb4a-43d5-b183-4436c0f449d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:29.891042 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2076bd6-fb4a-43d5-b183-4436c0f449d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:29.897157 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1c471027-c3ba-4de7-8440-e80cd382f586 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25" status: 200 len: 287 microversion: 2.1 time: 0.067353 Aug 19 09:17:29.898008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 16/32] 10.222.0.32 () {58 vars in 1251 bytes} [Thu Aug 19 09:17:29 2021] GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:29.998460 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f0c83bd6-82ab-41f3-bcb8-3c2bcab8af49 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:29.999136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f0c83bd6-82ab-41f3-bcb8-3c2bcab8af49 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:30.005894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f0c83bd6-82ab-41f3-bcb8-3c2bcab8af49 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:30.015164 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f0c83bd6-82ab-41f3-bcb8-3c2bcab8af49 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:30.015700 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f0c83bd6-82ab-41f3-bcb8-3c2bcab8af49 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:30.016139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f0c83bd6-82ab-41f3-bcb8-3c2bcab8af49 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:30.062854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b2076bd6-fb4a-43d5-b183-4436c0f449d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:30.070609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b2076bd6-fb4a-43d5-b183-4436c0f449d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1221 microversion: 2.1 time: 0.199830 Aug 19 09:17:30.073861 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 17/33] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:29 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1221 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:30.136120 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f0c83bd6-82ab-41f3-bcb8-3c2bcab8af49 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:30.148921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f0c83bd6-82ab-41f3-bcb8-3c2bcab8af49 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1211 microversion: 2.1 time: 0.155109 Aug 19 09:17:30.151477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 17/34] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:29 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:30.556330 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1052116150", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82e71227-b874-48ff-b3e0-b3bc213455c5"}]}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:30.652621 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] validate_networks() for [('82e71227-b874-48ff-b3e0-b3bc213455c5', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:17:30.913216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-55461ff0-b123-485a-afb4-13e5e6c7ef27 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb818ce820>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:30.979135 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-55461ff0-b123-485a-afb4-13e5e6c7ef27 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25" status: 200 len: 288 microversion: 2.1 time: 0.072684 Aug 19 09:17:30.979901 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 18/35] 10.222.0.32 () {58 vars in 1251 bytes} [Thu Aug 19 09:17:30 2021] GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25 => generated 288 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:17:30.992185 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-046a6657-c0d8-47fd-81ce-303779ce0a17 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb818cec10>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:31.192354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-046a6657-c0d8-47fd-81ce-303779ce0a17 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25" status: 202 len: 0 microversion: 2.1 time: 0.204066 Aug 19 09:17:31.192934 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 19/36] 10.222.0.32 () {58 vars in 1254 bytes} [Thu Aug 19 09:17:30 2021] DELETE /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:17:31.205704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ac6e4a35-f720-456d-b943-bacac290ed8b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:31.206358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ac6e4a35-f720-456d-b943-bacac290ed8b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:31.254039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ac6e4a35-f720-456d-b943-bacac290ed8b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:31.256175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ac6e4a35-f720-456d-b943-bacac290ed8b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:31.260081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ac6e4a35-f720-456d-b943-bacac290ed8b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:31.263929 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ac6e4a35-f720-456d-b943-bacac290ed8b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:31.505288 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:17:31.505934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:17:31.506507 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:17:31.507053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:17:31.507642 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:17:31.526677 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:31.532039 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:31.536590 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:31.537916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:31.614557 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ac6e4a35-f720-456d-b943-bacac290ed8b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:31.629028 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Getting quotas for project c12ed2bcdb61430986f3980ed2e7a8bd. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:17:31.632949 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ac6e4a35-f720-456d-b943-bacac290ed8b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1213 microversion: 2.1 time: 0.430954 Aug 19 09:17:31.633538 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 20/37] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:31 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1213 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:31.634544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Getting quotas for user 6694bf551f214f6e851cd166a4161495 and project c12ed2bcdb61430986f3980ed2e7a8bd. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:17:31.648904 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-aa0c9f5f-cfd6-423d-a898-d2c5bfe36b10 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:31.649974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-aa0c9f5f-cfd6-423d-a898-d2c5bfe36b10 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:31.667828 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-aa0c9f5f-cfd6-423d-a898-d2c5bfe36b10 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:31.668900 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-aa0c9f5f-cfd6-423d-a898-d2c5bfe36b10 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:31.670912 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-aa0c9f5f-cfd6-423d-a898-d2c5bfe36b10 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:31.671863 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-aa0c9f5f-cfd6-423d-a898-d2c5bfe36b10 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:31.677338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:17:31.680779 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:17:31.827638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-96e41aac-999f-4a03-bde6-fcc87c374360 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.518129 Aug 19 09:17:31.837774 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 18/38] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:17:30 2021] POST /compute/v2.1/servers => generated 383 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:17:31.844357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3a07fe0c-e10e-4135-876b-43073e93978f tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb8189bc10>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:31.929532 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-3a07fe0c-e10e-4135-876b-43073e93978f tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] HTTP exception thrown: Snapshot 08a23d5c-5d8c-4707-8767-df15622f4b25 could not be found. Aug 19 09:17:31.930496 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3a07fe0c-e10e-4135-876b-43073e93978f tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Returning 404 to user: Snapshot 08a23d5c-5d8c-4707-8767-df15622f4b25 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:17:31.931485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3a07fe0c-e10e-4135-876b-43073e93978f tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25" status: 404 len: 111 microversion: 2.1 time: 0.093220 Aug 19 09:17:31.932631 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 19/39] 10.222.0.32 () {58 vars in 1251 bytes} [Thu Aug 19 09:17:31 2021] GET /compute/v2.1/os-snapshots/08a23d5c-5d8c-4707-8767-df15622f4b25 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:17:32.189967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-aa0c9f5f-cfd6-423d-a898-d2c5bfe36b10 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:32.214584 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-aa0c9f5f-cfd6-423d-a898-d2c5bfe36b10 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1285 microversion: 2.1 time: 0.579040 Aug 19 09:17:32.215229 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 21/40] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:31 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1285 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:32.250433 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-181d7da1-cae2-40c9-9779-884f2cd723b8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:32.251153 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-181d7da1-cae2-40c9-9779-884f2cd723b8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:32.357162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-181d7da1-cae2-40c9-9779-884f2cd723b8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:32.412494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-181d7da1-cae2-40c9-9779-884f2cd723b8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1222 microversion: 2.1 time: 0.142596 Aug 19 09:17:32.412494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 22/41] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:32 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1222 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:32.413733 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9b382b75-d3c4-477e-b13c-c6d507d5d9b2 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb818ebe50>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:32.636756 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ee681cac-285f-4e9b-bbce-f902575ac67e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'create', calling method: .version_select at 0x7fdb8189b3a0>, body: {"keypair": {"name": "tempest-keypair-1809302607"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:32.637281 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9b382b75-d3c4-477e-b13c-c6d507d5d9b2 tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87" status: 202 len: 0 microversion: 2.1 time: 0.242989 Aug 19 09:17:32.637426 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 23/42] 10.222.0.32 () {58 vars in 1248 bytes} [Thu Aug 19 09:17:32 2021] DELETE /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:17:32.644109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-17cdb285-4d81-463c-ab5a-db539634908e tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb818b1160>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:32.752542 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-ee681cac-285f-4e9b-bbce-f902575ac67e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for project 0a913122239e44edb71a2fd07a99b275. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:17:32.768651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-ee681cac-285f-4e9b-bbce-f902575ac67e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for user 90d8d5eeacf74470bd13713074a281db and project 0a913122239e44edb71a2fd07a99b275. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:17:32.781070 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-17cdb285-4d81-463c-ab5a-db539634908e tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/bda00df5-6d4c-4cf8-bae8-559622e1fcf5" status: 200 len: 350 microversion: 2.1 time: 0.142352 Aug 19 09:17:32.781908 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 24/43] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:17:32 2021] GET /compute/v2.1/os-volumes/bda00df5-6d4c-4cf8-bae8-559622e1fcf5 => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:32.792028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-34f7cf23-10ef-43c0-9266-d76e3bb8b9ee tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb81908ee0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:32.953899 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-34f7cf23-10ef-43c0-9266-d76e3bb8b9ee tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87" status: 200 len: 344 microversion: 2.1 time: 0.170934 Aug 19 09:17:32.954685 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 25/44] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:17:32 2021] GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:32.961900 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f3727f64-5799-4f0a-be27-d3c706293aa9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:32.962711 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f3727f64-5799-4f0a-be27-d3c706293aa9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:32.971771 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3727f64-5799-4f0a-be27-d3c706293aa9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:32.972657 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3727f64-5799-4f0a-be27-d3c706293aa9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:32.973691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3727f64-5799-4f0a-be27-d3c706293aa9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:32.974564 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3727f64-5799-4f0a-be27-d3c706293aa9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:33.265684 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-ee681cac-285f-4e9b-bbce-f902575ac67e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for project 0a913122239e44edb71a2fd07a99b275. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:17:33.282422 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-ee681cac-285f-4e9b-bbce-f902575ac67e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for user 90d8d5eeacf74470bd13713074a281db and project 0a913122239e44edb71a2fd07a99b275. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:17:33.304486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f3727f64-5799-4f0a-be27-d3c706293aa9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:33.315720 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f3727f64-5799-4f0a-be27-d3c706293aa9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1275 microversion: 2.1 time: 0.356641 Aug 19 09:17:33.321500 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 26/45] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:32 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1275 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:33.333270 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ee681cac-285f-4e9b-bbce-f902575ac67e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.399385 Aug 19 09:17:33.335408 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 20/46] 10.222.0.32 () {62 vars in 1199 bytes} [Thu Aug 19 09:17:31 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1402 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 19 09:17:33.347164 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8e9f010c-9891-444e-8e5f-533f35ec21c9 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb818ebe50>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:33.352721 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1166939297", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82e71227-b874-48ff-b3e0-b3bc213455c5"}]}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:33.517087 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] validate_networks() for [('82e71227-b874-48ff-b3e0-b3bc213455c5', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:17:33.658375 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8e9f010c-9891-444e-8e5f-533f35ec21c9 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.334838 Aug 19 09:17:33.659367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 27/47] 10.222.0.32 () {58 vars in 1134 bytes} [Thu Aug 19 09:17:33 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:33.672603 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c346fca7-0230-4c21-af3f-c37543ef0561 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:33.673223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c346fca7-0230-4c21-af3f-c37543ef0561 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:33.691732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c346fca7-0230-4c21-af3f-c37543ef0561 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:33.696659 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c346fca7-0230-4c21-af3f-c37543ef0561 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:33.702221 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c346fca7-0230-4c21-af3f-c37543ef0561 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:33.703201 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c346fca7-0230-4c21-af3f-c37543ef0561 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:33.989950 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c346fca7-0230-4c21-af3f-c37543ef0561 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:34.008183 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c346fca7-0230-4c21-af3f-c37543ef0561 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1273 microversion: 2.1 time: 0.347645 Aug 19 09:17:34.008807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 28/48] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:33 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:34.047628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9de6df81-aa3a-46d9-b0b0-652636ac6e68 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb81867550>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:34.304743 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9de6df81-aa3a-46d9-b0b0-652636ac6e68 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.279194 Aug 19 09:17:34.305524 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 29/49] 10.222.0.32 () {58 vars in 1149 bytes} [Thu Aug 19 09:17:34 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:34.316882 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-64df9639-a91c-4b1c-8459-80117c167ffe tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb8187d5e0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:34.391501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-64df9639-a91c-4b1c-8459-80117c167ffe tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] HTTP exception thrown: Volume fc392d8a-491e-4568-8d10-c1a4b99c7b87 could not be found. Aug 19 09:17:34.392319 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-64df9639-a91c-4b1c-8459-80117c167ffe tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Returning 404 to user: Volume fc392d8a-491e-4568-8d10-c1a4b99c7b87 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:17:34.393426 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-64df9639-a91c-4b1c-8459-80117c167ffe tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87" status: 404 len: 109 microversion: 2.1 time: 0.080132 Aug 19 09:17:34.394465 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 30/50] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:17:34 2021] GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:17:34.402465 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-92b73f8d-f3c8-48b8-889a-72975bf51ba8 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb818ce4c0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:34.585834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-92b73f8d-f3c8-48b8-889a-72975bf51ba8 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.190004 Aug 19 09:17:34.599008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 31/51] 10.222.0.32 () {58 vars in 1134 bytes} [Thu Aug 19 09:17:34 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:34.604830 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e34efb2e-7daf-48eb-9a5a-675f6c62540b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:34.605774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e34efb2e-7daf-48eb-9a5a-675f6c62540b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:34.625610 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e34efb2e-7daf-48eb-9a5a-675f6c62540b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:34.626225 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e34efb2e-7daf-48eb-9a5a-675f6c62540b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:34.627354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e34efb2e-7daf-48eb-9a5a-675f6c62540b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:34.627944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e34efb2e-7daf-48eb-9a5a-675f6c62540b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:34.799396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e34efb2e-7daf-48eb-9a5a-675f6c62540b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:34.813592 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e34efb2e-7daf-48eb-9a5a-675f6c62540b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1275 microversion: 2.1 time: 0.212544 Aug 19 09:17:34.815201 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 32/52] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:34 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:34.869503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-18f2774a-4fb8-4a56-aac8-74236014f2ee tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb818ebd30>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:34.910859 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-18f2774a-4fb8-4a56-aac8-74236014f2ee tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] HTTP exception thrown: Volume fc392d8a-491e-4568-8d10-c1a4b99c7b87 could not be found. Aug 19 09:17:34.911902 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-18f2774a-4fb8-4a56-aac8-74236014f2ee tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Returning 404 to user: Volume fc392d8a-491e-4568-8d10-c1a4b99c7b87 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:17:34.918704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-18f2774a-4fb8-4a56-aac8-74236014f2ee tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87" status: 404 len: 109 microversion: 2.1 time: 0.097707 Aug 19 09:17:34.920647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 33/53] 10.222.0.32 () {58 vars in 1248 bytes} [Thu Aug 19 09:17:34 2021] DELETE /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:17:34.926399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9773cdd1-a9ec-4604-b74c-182a493ab970 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb819080d0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:35.083826 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9773cdd1-a9ec-4604-b74c-182a493ab970 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.161721 Aug 19 09:17:35.086525 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 34/54] 10.222.0.32 () {58 vars in 1167 bytes} [Thu Aug 19 09:17:34 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:35.091542 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4dde1ede-7447-404e-a162-9c42ba264d3b tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Calling method '.version_select at 0x7fdb822539d0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:35.139848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-4dde1ede-7447-404e-a162-9c42ba264d3b tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] HTTP exception thrown: Volume fc392d8a-491e-4568-8d10-c1a4b99c7b87 could not be found. Aug 19 09:17:35.143474 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4dde1ede-7447-404e-a162-9c42ba264d3b tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] Returning 404 to user: Volume fc392d8a-491e-4568-8d10-c1a4b99c7b87 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:17:35.146875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4dde1ede-7447-404e-a162-9c42ba264d3b tempest-VolumesSnapshotsTestJSON-379228551 tempest-VolumesSnapshotsTestJSON-379228551-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87" status: 404 len: 109 microversion: 2.1 time: 0.057195 Aug 19 09:17:35.148181 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 35/55] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:17:35 2021] GET /compute/v2.1/os-volumes/fc392d8a-491e-4568-8d10-c1a4b99c7b87 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:17:35.155683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-66c9c761-168b-414a-85f2-0992abfa73a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:35.157039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-66c9c761-168b-414a-85f2-0992abfa73a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:35.167154 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66c9c761-168b-414a-85f2-0992abfa73a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:35.168042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66c9c761-168b-414a-85f2-0992abfa73a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:35.169042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66c9c761-168b-414a-85f2-0992abfa73a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:35.170129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66c9c761-168b-414a-85f2-0992abfa73a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:35.828007 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-66c9c761-168b-414a-85f2-0992abfa73a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:35.838526 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-66c9c761-168b-414a-85f2-0992abfa73a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.687141 Aug 19 09:17:35.839071 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 36/56] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:35 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:35.857082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-278320a1-0cd4-4b7e-9d2a-da0d3f4a2074 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb818ce3a0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:36.055092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:17:36.055912 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:17:36.056239 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:17:36.056888 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:17:36.057521 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:17:36.074757 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:36.076068 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:36.077097 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:36.078094 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:36.114615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-278320a1-0cd4-4b7e-9d2a-da0d3f4a2074 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.274012 Aug 19 09:17:36.116838 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 37/57] 10.222.0.32 () {58 vars in 1170 bytes} [Thu Aug 19 09:17:35 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:36.129366 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Getting quotas for project c12ed2bcdb61430986f3980ed2e7a8bd. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:17:36.132742 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9f9565c3-a518-4114-83c3-6fa8f32f6232 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:36.133440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9f9565c3-a518-4114-83c3-6fa8f32f6232 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:36.140620 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Getting quotas for user 6694bf551f214f6e851cd166a4161495 and project c12ed2bcdb61430986f3980ed2e7a8bd. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:17:36.163391 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9f9565c3-a518-4114-83c3-6fa8f32f6232 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:36.167365 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:17:36.168466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9f9565c3-a518-4114-83c3-6fa8f32f6232 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:36.169364 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9f9565c3-a518-4114-83c3-6fa8f32f6232 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:36.169799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9f9565c3-a518-4114-83c3-6fa8f32f6232 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:36.172841 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:17:36.305886 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7ae6e78c-4d98-488d-a944-7ad9b5052e3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.969339 Aug 19 09:17:36.306780 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 21/58] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:17:33 2021] POST /compute/v2.1/servers => generated 383 bytes in 2971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:17:36.314085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7fe9e50a-f109-44a9-8549-e10780cc5fcb tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb8186baf0>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:36.483549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7fe9e50a-f109-44a9-8549-e10780cc5fcb tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.175044 Aug 19 09:17:36.484387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 22/59] 10.222.0.32 () {58 vars in 1155 bytes} [Thu Aug 19 09:17:36 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:36.488833 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2dfa5c6f-e5ec-44a9-a29f-53051dbf7555 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:36.489449 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2dfa5c6f-e5ec-44a9-a29f-53051dbf7555 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:36.618187 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2dfa5c6f-e5ec-44a9-a29f-53051dbf7555 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:36.649732 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2dfa5c6f-e5ec-44a9-a29f-53051dbf7555 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1222 microversion: 2.1 time: 0.162692 Aug 19 09:17:36.653219 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 23/60] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:36 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:36.667570 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-71246f4f-245d-4556-8667-acba2eee1301 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb819165e0>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:36.823801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-71246f4f-245d-4556-8667-acba2eee1301 tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.166225 Aug 19 09:17:36.824634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 24/61] 10.222.0.32 () {58 vars in 1188 bytes} [Thu Aug 19 09:17:36 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:36.837514 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ecf66272-13a0-4618-b1c3-b1d6c71d3b0a tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] Calling method '.version_select at 0x7fdb8102d3a0>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:37.049127 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ecf66272-13a0-4618-b1c3-b1d6c71d3b0a tempest-VolumesTestJSON-573013564 tempest-VolumesTestJSON-573013564-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.215739 Aug 19 09:17:37.049905 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 25/62] 10.222.0.32 () {58 vars in 1155 bytes} [Thu Aug 19 09:17:36 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:17:37.058329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2614a67e-b240-4771-a187-ce046596289b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:37.060302 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2614a67e-b240-4771-a187-ce046596289b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:37.101153 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9f9565c3-a518-4114-83c3-6fa8f32f6232 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:37.110270 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9f9565c3-a518-4114-83c3-6fa8f32f6232 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.986122 Aug 19 09:17:37.111113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2614a67e-b240-4771-a187-ce046596289b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:37.113154 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2614a67e-b240-4771-a187-ce046596289b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:37.117890 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2614a67e-b240-4771-a187-ce046596289b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:37.119247 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 38/63] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:36 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:37.119368 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2614a67e-b240-4771-a187-ce046596289b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:37.657411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2614a67e-b240-4771-a187-ce046596289b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:37.669116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2614a67e-b240-4771-a187-ce046596289b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.617709 Aug 19 09:17:37.671561 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 26/64] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:37 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:37.676203 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-18bfa9d7-eb92-4c77-84f3-0be1c5ef20dd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:37.676851 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-18bfa9d7-eb92-4c77-84f3-0be1c5ef20dd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:37.690876 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18bfa9d7-eb92-4c77-84f3-0be1c5ef20dd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:37.692090 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18bfa9d7-eb92-4c77-84f3-0be1c5ef20dd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:37.694290 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18bfa9d7-eb92-4c77-84f3-0be1c5ef20dd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:37.694886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18bfa9d7-eb92-4c77-84f3-0be1c5ef20dd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:37.808081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-18bfa9d7-eb92-4c77-84f3-0be1c5ef20dd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:37.819894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-18bfa9d7-eb92-4c77-84f3-0be1c5ef20dd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.151714 Aug 19 09:17:37.820493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 39/65] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:37 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:38.138387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bd5fa844-7171-48b4-9be5-12647f036fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:38.139411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bd5fa844-7171-48b4-9be5-12647f036fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:38.146329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bd5fa844-7171-48b4-9be5-12647f036fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:38.146779 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bd5fa844-7171-48b4-9be5-12647f036fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:38.152689 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bd5fa844-7171-48b4-9be5-12647f036fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:38.153196 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bd5fa844-7171-48b4-9be5-12647f036fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:38.487359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bd5fa844-7171-48b4-9be5-12647f036fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:38.501089 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bd5fa844-7171-48b4-9be5-12647f036fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.366345 Aug 19 09:17:38.504936 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 27/66] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:38 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:38.695826 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a21b46c1-35d9-4b53-beae-d91e73532fe6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:38.701163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a21b46c1-35d9-4b53-beae-d91e73532fe6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:38.718770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a21b46c1-35d9-4b53-beae-d91e73532fe6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:38.720644 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a21b46c1-35d9-4b53-beae-d91e73532fe6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:38.722311 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a21b46c1-35d9-4b53-beae-d91e73532fe6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:38.726770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a21b46c1-35d9-4b53-beae-d91e73532fe6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:38.837634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3eebb2fa-0d53-42c4-b8c0-6f004896c11a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:38.838493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3eebb2fa-0d53-42c4-b8c0-6f004896c11a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:38.848736 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3eebb2fa-0d53-42c4-b8c0-6f004896c11a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:38.849456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3eebb2fa-0d53-42c4-b8c0-6f004896c11a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:38.850252 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3eebb2fa-0d53-42c4-b8c0-6f004896c11a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:38.850833 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3eebb2fa-0d53-42c4-b8c0-6f004896c11a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:38.962001 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3eebb2fa-0d53-42c4-b8c0-6f004896c11a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:38.974037 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3eebb2fa-0d53-42c4-b8c0-6f004896c11a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.140228 Aug 19 09:17:38.976808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 28/67] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:38 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:17:39.004602 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a21b46c1-35d9-4b53-beae-d91e73532fe6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:39.013177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a21b46c1-35d9-4b53-beae-d91e73532fe6 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.330562 Aug 19 09:17:39.014953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 40/68] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:38 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:39.081759 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1521203348", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20ee0fa8-4951-43ba-b13c-ba279ba12aa3"}], "security_groups": [{"name": "tempest-securitygroup--447702213"}], "key_name": "tempest-keypair-1809302607", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:39.236803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] validate_networks() for [('20ee0fa8-4951-43ba-b13c-ba279ba12aa3', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:17:39.520383 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c88f5c3e-03d6-405e-88b2-810738b2f9bd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:39.521229 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c88f5c3e-03d6-405e-88b2-810738b2f9bd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:39.531992 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c88f5c3e-03d6-405e-88b2-810738b2f9bd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:39.534954 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c88f5c3e-03d6-405e-88b2-810738b2f9bd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:39.543025 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c88f5c3e-03d6-405e-88b2-810738b2f9bd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:39.543597 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c88f5c3e-03d6-405e-88b2-810738b2f9bd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:39.814607 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c88f5c3e-03d6-405e-88b2-810738b2f9bd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:39.830498 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c88f5c3e-03d6-405e-88b2-810738b2f9bd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.313999 Aug 19 09:17:39.831409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 41/69] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:39 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:39.840359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:17:39.840745 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:17:39.841630 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:17:39.842295 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:17:39.842747 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:17:39.872642 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:39.873621 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:39.875182 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:39.875882 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:39.895035 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for project 0a913122239e44edb71a2fd07a99b275. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:17:39.898829 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for user 90d8d5eeacf74470bd13713074a281db and project 0a913122239e44edb71a2fd07a99b275. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:17:39.910752 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:17:39.913120 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:17:39.973126 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c2b96934-57e7-4e9c-829b-0b2fc001cd05 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.895696 Aug 19 09:17:39.980552 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 29/70] 10.222.0.32 () {62 vars in 1188 bytes} [Thu Aug 19 09:17:39 2021] POST /compute/v2.1/servers => generated 401 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 19 09:17:39.985450 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-91242139-9d14-455e-ab1b-632902a2ef3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:39.986073 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-91242139-9d14-455e-ab1b-632902a2ef3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:40.008500 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9dc4c903-68ed-4945-b939-010b1c94d027 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:40.009261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9dc4c903-68ed-4945-b939-010b1c94d027 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:40.030643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9dc4c903-68ed-4945-b939-010b1c94d027 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:40.031406 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9dc4c903-68ed-4945-b939-010b1c94d027 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:40.032473 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9dc4c903-68ed-4945-b939-010b1c94d027 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:40.032923 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9dc4c903-68ed-4945-b939-010b1c94d027 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:40.090705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-91242139-9d14-455e-ab1b-632902a2ef3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:40.103811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-91242139-9d14-455e-ab1b-632902a2ef3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:40.105601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-91242139-9d14-455e-ab1b-632902a2ef3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:40.107292 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-91242139-9d14-455e-ab1b-632902a2ef3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1282 microversion: 2.20 time: 0.125629 Aug 19 09:17:40.110852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9dc4c903-68ed-4945-b939-010b1c94d027 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:40.117476 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 42/71] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:39 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:40.130939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9dc4c903-68ed-4945-b939-010b1c94d027 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.132090 Aug 19 09:17:40.132634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 30/72] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:39 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:40.134924 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a3f51ef3-5d11-452b-9e84-066b3637ab87 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:40.135722 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a3f51ef3-5d11-452b-9e84-066b3637ab87 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:40.143723 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a3f51ef3-5d11-452b-9e84-066b3637ab87 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:40.144392 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a3f51ef3-5d11-452b-9e84-066b3637ab87 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:40.145391 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a3f51ef3-5d11-452b-9e84-066b3637ab87 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:40.146001 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a3f51ef3-5d11-452b-9e84-066b3637ab87 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:40.531191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a3f51ef3-5d11-452b-9e84-066b3637ab87 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:40.572347 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a3f51ef3-5d11-452b-9e84-066b3637ab87 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.453068 Aug 19 09:17:40.573178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 43/73] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:40 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:40.848048 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ea37396a-a576-450e-b446-eaeef66af7e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:40.848669 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ea37396a-a576-450e-b446-eaeef66af7e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:40.861268 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ea37396a-a576-450e-b446-eaeef66af7e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:40.861721 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ea37396a-a576-450e-b446-eaeef66af7e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:40.864129 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ea37396a-a576-450e-b446-eaeef66af7e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:40.864576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ea37396a-a576-450e-b446-eaeef66af7e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:41.046155 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ea37396a-a576-450e-b446-eaeef66af7e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:41.056495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ea37396a-a576-450e-b446-eaeef66af7e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.212168 Aug 19 09:17:41.061104 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 31/74] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:40 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:41.128784 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ded321e3-e921-437e-a30a-4fe3bcb81779 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:41.129629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ded321e3-e921-437e-a30a-4fe3bcb81779 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:41.139849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ded321e3-e921-437e-a30a-4fe3bcb81779 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:41.140509 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ded321e3-e921-437e-a30a-4fe3bcb81779 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:41.141384 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ded321e3-e921-437e-a30a-4fe3bcb81779 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:41.141974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ded321e3-e921-437e-a30a-4fe3bcb81779 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:41.150771 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-50ba741e-554f-4f05-8cbb-dae94408dae0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:41.151711 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-50ba741e-554f-4f05-8cbb-dae94408dae0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:41.160368 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-50ba741e-554f-4f05-8cbb-dae94408dae0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:41.164088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-50ba741e-554f-4f05-8cbb-dae94408dae0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:41.165274 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-50ba741e-554f-4f05-8cbb-dae94408dae0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:41.168581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-50ba741e-554f-4f05-8cbb-dae94408dae0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:41.238367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ded321e3-e921-437e-a30a-4fe3bcb81779 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:41.254851 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ded321e3-e921-437e-a30a-4fe3bcb81779 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:41.254851 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ded321e3-e921-437e-a30a-4fe3bcb81779 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:41.254851 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ded321e3-e921-437e-a30a-4fe3bcb81779 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1286 microversion: 2.20 time: 0.131675 Aug 19 09:17:41.264200 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 44/75] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:41 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:41.354677 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-50ba741e-554f-4f05-8cbb-dae94408dae0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:41.377818 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-50ba741e-554f-4f05-8cbb-dae94408dae0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.231917 Aug 19 09:17:41.381754 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 32/76] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:41 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:41.590231 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ca9a030d-c42d-4f5b-b143-6a47775ea494 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:41.591418 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ca9a030d-c42d-4f5b-b143-6a47775ea494 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:41.603493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca9a030d-c42d-4f5b-b143-6a47775ea494 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:41.604194 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca9a030d-c42d-4f5b-b143-6a47775ea494 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:41.606977 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca9a030d-c42d-4f5b-b143-6a47775ea494 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:41.609282 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca9a030d-c42d-4f5b-b143-6a47775ea494 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:41.848648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ca9a030d-c42d-4f5b-b143-6a47775ea494 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:41.861756 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ca9a030d-c42d-4f5b-b143-6a47775ea494 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.271776 Aug 19 09:17:41.862704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 45/77] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:41 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:42.075352 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-15ab70a9-8810-414a-83e8-2fe4366cf88c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:42.077524 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-15ab70a9-8810-414a-83e8-2fe4366cf88c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:42.084504 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-15ab70a9-8810-414a-83e8-2fe4366cf88c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:42.085447 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-15ab70a9-8810-414a-83e8-2fe4366cf88c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:42.086307 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-15ab70a9-8810-414a-83e8-2fe4366cf88c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:42.086980 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-15ab70a9-8810-414a-83e8-2fe4366cf88c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:42.248823 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-15ab70a9-8810-414a-83e8-2fe4366cf88c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:42.257543 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-15ab70a9-8810-414a-83e8-2fe4366cf88c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.186962 Aug 19 09:17:42.258304 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 33/78] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:42 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:42.279231 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-01eb9990-1910-4d37-87d1-98c423b28945 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:42.280510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-01eb9990-1910-4d37-87d1-98c423b28945 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:42.288094 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01eb9990-1910-4d37-87d1-98c423b28945 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:42.288490 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01eb9990-1910-4d37-87d1-98c423b28945 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:42.289259 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01eb9990-1910-4d37-87d1-98c423b28945 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:42.289690 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01eb9990-1910-4d37-87d1-98c423b28945 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:42.355322 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-01eb9990-1910-4d37-87d1-98c423b28945 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:42.365251 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-01eb9990-1910-4d37-87d1-98c423b28945 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:42.366980 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-01eb9990-1910-4d37-87d1-98c423b28945 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:42.368355 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-01eb9990-1910-4d37-87d1-98c423b28945 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1286 microversion: 2.20 time: 0.093759 Aug 19 09:17:42.369094 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 46/79] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:42 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:42.399553 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-593bb809-dbfd-4317-b1be-c9ef2fe57f3d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:42.401616 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-593bb809-dbfd-4317-b1be-c9ef2fe57f3d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:42.410870 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-593bb809-dbfd-4317-b1be-c9ef2fe57f3d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:42.411819 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-593bb809-dbfd-4317-b1be-c9ef2fe57f3d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:42.412997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-593bb809-dbfd-4317-b1be-c9ef2fe57f3d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:42.413573 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-593bb809-dbfd-4317-b1be-c9ef2fe57f3d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:42.479397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-593bb809-dbfd-4317-b1be-c9ef2fe57f3d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:42.487797 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-593bb809-dbfd-4317-b1be-c9ef2fe57f3d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.093070 Aug 19 09:17:42.488485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 34/80] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:42 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:42.879647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-37ec0212-8200-4670-8f06-0d6357a1096b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:42.880267 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-37ec0212-8200-4670-8f06-0d6357a1096b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:42.886170 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-37ec0212-8200-4670-8f06-0d6357a1096b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:42.886896 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-37ec0212-8200-4670-8f06-0d6357a1096b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:42.893978 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-37ec0212-8200-4670-8f06-0d6357a1096b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:42.894666 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-37ec0212-8200-4670-8f06-0d6357a1096b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:43.046126 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-37ec0212-8200-4670-8f06-0d6357a1096b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:43.064652 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-37ec0212-8200-4670-8f06-0d6357a1096b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.188516 Aug 19 09:17:43.076033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 47/81] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:42 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:43.277667 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f5564f6a-afa7-48b6-b115-4ced57fcd160 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:43.279035 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f5564f6a-afa7-48b6-b115-4ced57fcd160 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:43.287821 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f5564f6a-afa7-48b6-b115-4ced57fcd160 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:43.289875 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f5564f6a-afa7-48b6-b115-4ced57fcd160 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:43.291120 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f5564f6a-afa7-48b6-b115-4ced57fcd160 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:43.296241 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f5564f6a-afa7-48b6-b115-4ced57fcd160 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:43.388245 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a0594097-482d-4046-80fe-69b0b488d8a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:43.399097 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a0594097-482d-4046-80fe-69b0b488d8a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:43.408848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a0594097-482d-4046-80fe-69b0b488d8a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:43.410461 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a0594097-482d-4046-80fe-69b0b488d8a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:43.415711 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a0594097-482d-4046-80fe-69b0b488d8a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:43.416442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a0594097-482d-4046-80fe-69b0b488d8a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:43.539469 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a0594097-482d-4046-80fe-69b0b488d8a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:43.551785 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a0594097-482d-4046-80fe-69b0b488d8a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:43.553387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f5564f6a-afa7-48b6-b115-4ced57fcd160 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:43.554760 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a0594097-482d-4046-80fe-69b0b488d8a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:43.557770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a0594097-482d-4046-80fe-69b0b488d8a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1286 microversion: 2.20 time: 0.173548 Aug 19 09:17:43.562828 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f5564f6a-afa7-48b6-b115-4ced57fcd160 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.288741 Aug 19 09:17:43.570886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 48/82] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:43 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1286 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:43.572511 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 35/83] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:43 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:43.580329 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-186bf13c-2401-4730-8f9b-74f0253fea5f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:43.582498 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-186bf13c-2401-4730-8f9b-74f0253fea5f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:43.593243 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-186bf13c-2401-4730-8f9b-74f0253fea5f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:43.594129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-186bf13c-2401-4730-8f9b-74f0253fea5f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:43.595230 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-186bf13c-2401-4730-8f9b-74f0253fea5f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:43.596417 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-186bf13c-2401-4730-8f9b-74f0253fea5f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:43.696702 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-186bf13c-2401-4730-8f9b-74f0253fea5f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:43.705080 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-186bf13c-2401-4730-8f9b-74f0253fea5f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.130836 Aug 19 09:17:43.715430 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 49/84] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:43 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:44.090345 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a39f4a68-9074-4148-9531-aaa2516bad78 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:44.091893 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a39f4a68-9074-4148-9531-aaa2516bad78 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:44.106774 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a39f4a68-9074-4148-9531-aaa2516bad78 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:44.107598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a39f4a68-9074-4148-9531-aaa2516bad78 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:44.108672 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a39f4a68-9074-4148-9531-aaa2516bad78 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:44.109493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a39f4a68-9074-4148-9531-aaa2516bad78 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:44.330903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a39f4a68-9074-4148-9531-aaa2516bad78 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:44.348608 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a39f4a68-9074-4148-9531-aaa2516bad78 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.261576 Aug 19 09:17:44.353045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 36/85] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:44 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:44.581109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6ad11c63-a8e5-4957-9eac-9445367169dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:44.581834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6ad11c63-a8e5-4957-9eac-9445367169dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:44.588484 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9911a9f6-759b-479f-bcdf-f2d7495cd0ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:44.589178 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9911a9f6-759b-479f-bcdf-f2d7495cd0ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:44.592230 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6ad11c63-a8e5-4957-9eac-9445367169dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:44.593620 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6ad11c63-a8e5-4957-9eac-9445367169dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:44.594407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6ad11c63-a8e5-4957-9eac-9445367169dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:44.595388 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6ad11c63-a8e5-4957-9eac-9445367169dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:44.606003 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9911a9f6-759b-479f-bcdf-f2d7495cd0ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:44.606003 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9911a9f6-759b-479f-bcdf-f2d7495cd0ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:44.606003 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9911a9f6-759b-479f-bcdf-f2d7495cd0ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:44.606003 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9911a9f6-759b-479f-bcdf-f2d7495cd0ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:44.738440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6ad11c63-a8e5-4957-9eac-9445367169dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:44.746284 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6ad11c63-a8e5-4957-9eac-9445367169dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:44.748151 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6ad11c63-a8e5-4957-9eac-9445367169dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:44.749173 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6ad11c63-a8e5-4957-9eac-9445367169dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1286 microversion: 2.20 time: 0.172649 Aug 19 09:17:44.766107 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 50/86] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:44 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1286 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:44.774291 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5da41cf4-0455-44b3-bbf0-5119d4510024 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:44.787005 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5da41cf4-0455-44b3-bbf0-5119d4510024 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:44.792947 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5da41cf4-0455-44b3-bbf0-5119d4510024 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:44.793598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5da41cf4-0455-44b3-bbf0-5119d4510024 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:44.794784 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5da41cf4-0455-44b3-bbf0-5119d4510024 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:44.795390 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5da41cf4-0455-44b3-bbf0-5119d4510024 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:44.869050 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9911a9f6-759b-479f-bcdf-f2d7495cd0ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:44.887649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9911a9f6-759b-479f-bcdf-f2d7495cd0ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.294550 Aug 19 09:17:44.887649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 37/87] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:44 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:44.935837 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5da41cf4-0455-44b3-bbf0-5119d4510024 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:44.955848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5da41cf4-0455-44b3-bbf0-5119d4510024 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.180795 Aug 19 09:17:44.956505 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 51/88] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:44 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:45.366751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7c278b01-f7f5-4882-b9d3-97cb6cdc26ce tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:45.367368 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7c278b01-f7f5-4882-b9d3-97cb6cdc26ce tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:45.393118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c278b01-f7f5-4882-b9d3-97cb6cdc26ce tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:45.393750 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c278b01-f7f5-4882-b9d3-97cb6cdc26ce tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:45.394934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c278b01-f7f5-4882-b9d3-97cb6cdc26ce tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:45.397273 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c278b01-f7f5-4882-b9d3-97cb6cdc26ce tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:45.619798 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7c278b01-f7f5-4882-b9d3-97cb6cdc26ce tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:45.631010 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7c278b01-f7f5-4882-b9d3-97cb6cdc26ce tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.264888 Aug 19 09:17:45.645311 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 38/89] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:45 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:45.775363 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-62b9cd18-c68c-4bbb-b274-15379fb83f73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:45.775967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-62b9cd18-c68c-4bbb-b274-15379fb83f73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:45.785119 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-62b9cd18-c68c-4bbb-b274-15379fb83f73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:45.785568 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-62b9cd18-c68c-4bbb-b274-15379fb83f73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:45.787140 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-62b9cd18-c68c-4bbb-b274-15379fb83f73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:45.790583 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-62b9cd18-c68c-4bbb-b274-15379fb83f73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:45.864078 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-62b9cd18-c68c-4bbb-b274-15379fb83f73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:45.876513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-62b9cd18-c68c-4bbb-b274-15379fb83f73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:45.878566 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-62b9cd18-c68c-4bbb-b274-15379fb83f73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:45.879871 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-62b9cd18-c68c-4bbb-b274-15379fb83f73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1286 microversion: 2.20 time: 0.109548 Aug 19 09:17:45.881010 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 52/90] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:45 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:45.898672 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9d73a1a2-b931-4f0f-a682-d26cbc5901a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:45.899305 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9d73a1a2-b931-4f0f-a682-d26cbc5901a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:45.907193 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d73a1a2-b931-4f0f-a682-d26cbc5901a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:45.907837 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d73a1a2-b931-4f0f-a682-d26cbc5901a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:45.908920 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d73a1a2-b931-4f0f-a682-d26cbc5901a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:45.909588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d73a1a2-b931-4f0f-a682-d26cbc5901a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:45.973787 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-92762347-6aaa-4911-b7e5-fdc1cceb6a45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:45.974401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-92762347-6aaa-4911-b7e5-fdc1cceb6a45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:45.986098 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-92762347-6aaa-4911-b7e5-fdc1cceb6a45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:45.986632 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-92762347-6aaa-4911-b7e5-fdc1cceb6a45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:45.988967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-92762347-6aaa-4911-b7e5-fdc1cceb6a45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:45.989838 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-92762347-6aaa-4911-b7e5-fdc1cceb6a45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:46.105503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9d73a1a2-b931-4f0f-a682-d26cbc5901a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:46.118925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9d73a1a2-b931-4f0f-a682-d26cbc5901a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.222767 Aug 19 09:17:46.121734 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 39/91] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:45 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:46.184345 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-92762347-6aaa-4911-b7e5-fdc1cceb6a45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:46.194184 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-92762347-6aaa-4911-b7e5-fdc1cceb6a45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.225132 Aug 19 09:17:46.198139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 53/92] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:45 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:46.650839 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1e8d5bf5-87e4-495b-97ab-53e7833e2b59 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:46.651725 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1e8d5bf5-87e4-495b-97ab-53e7833e2b59 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:46.661024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e8d5bf5-87e4-495b-97ab-53e7833e2b59 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:46.663557 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e8d5bf5-87e4-495b-97ab-53e7833e2b59 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:46.665462 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e8d5bf5-87e4-495b-97ab-53e7833e2b59 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:46.666179 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e8d5bf5-87e4-495b-97ab-53e7833e2b59 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:46.825459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1e8d5bf5-87e4-495b-97ab-53e7833e2b59 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:46.833023 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1e8d5bf5-87e4-495b-97ab-53e7833e2b59 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.186157 Aug 19 09:17:46.833888 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 40/93] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:46 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:46.898849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-95fa5c67-0ffe-45d1-bc82-84e2615e8804 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:46.899251 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-95fa5c67-0ffe-45d1-bc82-84e2615e8804 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:46.905976 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-95fa5c67-0ffe-45d1-bc82-84e2615e8804 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:46.906744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-95fa5c67-0ffe-45d1-bc82-84e2615e8804 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:46.907646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-95fa5c67-0ffe-45d1-bc82-84e2615e8804 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:46.908158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-95fa5c67-0ffe-45d1-bc82-84e2615e8804 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:47.000406 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-95fa5c67-0ffe-45d1-bc82-84e2615e8804 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:47.010574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-95fa5c67-0ffe-45d1-bc82-84e2615e8804 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:47.012463 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-95fa5c67-0ffe-45d1-bc82-84e2615e8804 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:47.014085 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-95fa5c67-0ffe-45d1-bc82-84e2615e8804 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1286 microversion: 2.20 time: 0.119881 Aug 19 09:17:47.014832 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 54/94] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:46 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:47.136503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c348e11d-6540-484e-a34f-a1f72a870e5b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:47.137561 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c348e11d-6540-484e-a34f-a1f72a870e5b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:47.147588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c348e11d-6540-484e-a34f-a1f72a870e5b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:47.148092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c348e11d-6540-484e-a34f-a1f72a870e5b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:47.148870 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c348e11d-6540-484e-a34f-a1f72a870e5b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:47.149303 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c348e11d-6540-484e-a34f-a1f72a870e5b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:47.213324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5446d55d-76a5-4690-b287-93b1576f8eb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:47.214320 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5446d55d-76a5-4690-b287-93b1576f8eb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:47.223163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5446d55d-76a5-4690-b287-93b1576f8eb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:47.223797 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5446d55d-76a5-4690-b287-93b1576f8eb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:47.225028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5446d55d-76a5-4690-b287-93b1576f8eb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:47.225698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5446d55d-76a5-4690-b287-93b1576f8eb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:47.308118 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5446d55d-76a5-4690-b287-93b1576f8eb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:47.324972 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5446d55d-76a5-4690-b287-93b1576f8eb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.115513 Aug 19 09:17:47.330065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 55/95] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:47 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:47.362548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c348e11d-6540-484e-a34f-a1f72a870e5b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:47.370221 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c348e11d-6540-484e-a34f-a1f72a870e5b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.237934 Aug 19 09:17:47.383325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 41/96] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:47 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:47.853005 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-da29987a-8bd9-43d7-ad5d-1409e28f8c29 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:47.853890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-da29987a-8bd9-43d7-ad5d-1409e28f8c29 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:47.862081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da29987a-8bd9-43d7-ad5d-1409e28f8c29 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:47.862749 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da29987a-8bd9-43d7-ad5d-1409e28f8c29 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:47.863782 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da29987a-8bd9-43d7-ad5d-1409e28f8c29 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:47.864388 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da29987a-8bd9-43d7-ad5d-1409e28f8c29 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:48.034643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-01a8e3b8-328d-4811-aa5d-1d6b8a3eb178 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:48.036037 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-01a8e3b8-328d-4811-aa5d-1d6b8a3eb178 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:48.042625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01a8e3b8-328d-4811-aa5d-1d6b8a3eb178 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:48.043075 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01a8e3b8-328d-4811-aa5d-1d6b8a3eb178 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:48.044379 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01a8e3b8-328d-4811-aa5d-1d6b8a3eb178 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:48.045123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01a8e3b8-328d-4811-aa5d-1d6b8a3eb178 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:48.110428 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-01a8e3b8-328d-4811-aa5d-1d6b8a3eb178 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:48.118813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-01a8e3b8-328d-4811-aa5d-1d6b8a3eb178 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:48.120340 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-01a8e3b8-328d-4811-aa5d-1d6b8a3eb178 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:48.121621 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-01a8e3b8-328d-4811-aa5d-1d6b8a3eb178 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1286 microversion: 2.20 time: 0.091533 Aug 19 09:17:48.122698 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 42/97] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:48 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:17:48.132861 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-da29987a-8bd9-43d7-ad5d-1409e28f8c29 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:48.140297 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-da29987a-8bd9-43d7-ad5d-1409e28f8c29 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.293775 Aug 19 09:17:48.141829 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 56/98] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:47 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:48.348844 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a1e782d2-e9c3-45d0-8330-4cafa614c505 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:48.349721 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a1e782d2-e9c3-45d0-8330-4cafa614c505 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:48.357463 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a1e782d2-e9c3-45d0-8330-4cafa614c505 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:48.357965 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a1e782d2-e9c3-45d0-8330-4cafa614c505 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:48.358718 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a1e782d2-e9c3-45d0-8330-4cafa614c505 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:48.359186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a1e782d2-e9c3-45d0-8330-4cafa614c505 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:48.391174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cab0b129-805d-45bc-8bdc-2433b2a75c89 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:48.392023 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cab0b129-805d-45bc-8bdc-2433b2a75c89 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:48.397834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cab0b129-805d-45bc-8bdc-2433b2a75c89 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:48.398456 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cab0b129-805d-45bc-8bdc-2433b2a75c89 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:48.399532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cab0b129-805d-45bc-8bdc-2433b2a75c89 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:48.400178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cab0b129-805d-45bc-8bdc-2433b2a75c89 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:48.470865 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a1e782d2-e9c3-45d0-8330-4cafa614c505 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:48.482594 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a1e782d2-e9c3-45d0-8330-4cafa614c505 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.142076 Aug 19 09:17:48.483699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 43/99] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:48 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:48.555706 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cab0b129-805d-45bc-8bdc-2433b2a75c89 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:48.568343 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cab0b129-805d-45bc-8bdc-2433b2a75c89 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.182002 Aug 19 09:17:48.569219 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 57/100] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:48 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:17:49.149065 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9c593263-ffd8-4e0e-8db7-2868135b814b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:49.149065 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9c593263-ffd8-4e0e-8db7-2868135b814b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:49.150894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c593263-ffd8-4e0e-8db7-2868135b814b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:49.153890 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c593263-ffd8-4e0e-8db7-2868135b814b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:49.153890 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c593263-ffd8-4e0e-8db7-2868135b814b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:49.158826 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1fa3fa4e-d43c-40e9-a27f-f0b2733267b1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:49.159688 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1fa3fa4e-d43c-40e9-a27f-f0b2733267b1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:49.164659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c593263-ffd8-4e0e-8db7-2868135b814b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:49.171759 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fa3fa4e-d43c-40e9-a27f-f0b2733267b1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:49.172457 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fa3fa4e-d43c-40e9-a27f-f0b2733267b1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:49.173448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fa3fa4e-d43c-40e9-a27f-f0b2733267b1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:49.173978 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fa3fa4e-d43c-40e9-a27f-f0b2733267b1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:49.246302 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9c593263-ffd8-4e0e-8db7-2868135b814b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:49.254839 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9c593263-ffd8-4e0e-8db7-2868135b814b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:49.256965 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9c593263-ffd8-4e0e-8db7-2868135b814b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:49.258206 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9c593263-ffd8-4e0e-8db7-2868135b814b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1286 microversion: 2.20 time: 0.121018 Aug 19 09:17:49.267469 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 44/101] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:49 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:49.345571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1fa3fa4e-d43c-40e9-a27f-f0b2733267b1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:49.354153 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1fa3fa4e-d43c-40e9-a27f-f0b2733267b1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.199588 Aug 19 09:17:49.354748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 58/102] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:49 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:49.498701 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9e4dd10b-0f5e-456e-ad9d-bdad4d79b779 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:49.502571 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9e4dd10b-0f5e-456e-ad9d-bdad4d79b779 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:49.508965 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e4dd10b-0f5e-456e-ad9d-bdad4d79b779 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:49.509408 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e4dd10b-0f5e-456e-ad9d-bdad4d79b779 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:49.510171 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e4dd10b-0f5e-456e-ad9d-bdad4d79b779 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:49.510687 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e4dd10b-0f5e-456e-ad9d-bdad4d79b779 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:49.588409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6cbaf254-6417-4ef4-af93-0c5e86fb4e0c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:49.589522 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6cbaf254-6417-4ef4-af93-0c5e86fb4e0c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:49.591782 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9e4dd10b-0f5e-456e-ad9d-bdad4d79b779 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:49.599147 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cbaf254-6417-4ef4-af93-0c5e86fb4e0c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:49.599907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cbaf254-6417-4ef4-af93-0c5e86fb4e0c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:49.600306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9e4dd10b-0f5e-456e-ad9d-bdad4d79b779 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.105452 Aug 19 09:17:49.600859 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cbaf254-6417-4ef4-af93-0c5e86fb4e0c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:49.601280 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cbaf254-6417-4ef4-af93-0c5e86fb4e0c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:49.610856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 45/103] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:49 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:49.744510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6cbaf254-6417-4ef4-af93-0c5e86fb4e0c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:49.752942 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6cbaf254-6417-4ef4-af93-0c5e86fb4e0c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.170213 Aug 19 09:17:49.753586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 59/104] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:49 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:50.281123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f379c96d-ab04-463b-8cf8-753c629503d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:50.281123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f379c96d-ab04-463b-8cf8-753c629503d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:50.284323 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f379c96d-ab04-463b-8cf8-753c629503d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:50.285028 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f379c96d-ab04-463b-8cf8-753c629503d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:50.285971 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f379c96d-ab04-463b-8cf8-753c629503d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:50.286422 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f379c96d-ab04-463b-8cf8-753c629503d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:50.362669 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f379c96d-ab04-463b-8cf8-753c629503d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:50.373974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b1426c20-228f-4766-8f03-ad50d371b396 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:50.373974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b1426c20-228f-4766-8f03-ad50d371b396 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:50.379966 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1426c20-228f-4766-8f03-ad50d371b396 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:50.382970 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1426c20-228f-4766-8f03-ad50d371b396 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:50.386542 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1426c20-228f-4766-8f03-ad50d371b396 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:50.387073 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1426c20-228f-4766-8f03-ad50d371b396 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:50.391227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f379c96d-ab04-463b-8cf8-753c629503d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:50.393036 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f379c96d-ab04-463b-8cf8-753c629503d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:50.395185 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f379c96d-ab04-463b-8cf8-753c629503d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1286 microversion: 2.20 time: 0.121211 Aug 19 09:17:50.396645 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 46/105] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:50 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:50.537501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b1426c20-228f-4766-8f03-ad50d371b396 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:50.545557 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b1426c20-228f-4766-8f03-ad50d371b396 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.177918 Aug 19 09:17:50.546121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 60/106] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:50 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:17:50.618771 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cf945adf-2428-4f95-8cfa-e64197d9e39a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:50.619418 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-cf945adf-2428-4f95-8cfa-e64197d9e39a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:50.627903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cf945adf-2428-4f95-8cfa-e64197d9e39a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:50.628606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cf945adf-2428-4f95-8cfa-e64197d9e39a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:50.629567 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cf945adf-2428-4f95-8cfa-e64197d9e39a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:50.630134 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cf945adf-2428-4f95-8cfa-e64197d9e39a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:50.704468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-cf945adf-2428-4f95-8cfa-e64197d9e39a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:50.711746 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-cf945adf-2428-4f95-8cfa-e64197d9e39a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.097619 Aug 19 09:17:50.712506 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 47/107] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:50 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:50.771943 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-85cd0d94-b4d0-4b01-b80c-e2199498573c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:50.773217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-85cd0d94-b4d0-4b01-b80c-e2199498573c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:50.781387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-85cd0d94-b4d0-4b01-b80c-e2199498573c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:50.782233 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-85cd0d94-b4d0-4b01-b80c-e2199498573c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:50.783304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-85cd0d94-b4d0-4b01-b80c-e2199498573c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:50.784048 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-85cd0d94-b4d0-4b01-b80c-e2199498573c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:50.936438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-85cd0d94-b4d0-4b01-b80c-e2199498573c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:50.943583 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-85cd0d94-b4d0-4b01-b80c-e2199498573c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.177587 Aug 19 09:17:50.944305 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 61/108] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:50 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:51.413797 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-187ea762-64e1-4028-8a52-69fcf1c7cd73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:51.414526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-187ea762-64e1-4028-8a52-69fcf1c7cd73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:51.421772 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-187ea762-64e1-4028-8a52-69fcf1c7cd73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:51.422224 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-187ea762-64e1-4028-8a52-69fcf1c7cd73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:51.423004 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-187ea762-64e1-4028-8a52-69fcf1c7cd73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:51.423473 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-187ea762-64e1-4028-8a52-69fcf1c7cd73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:51.563343 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6770366f-75bd-46da-b298-d88ab7eee15f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:51.564067 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6770366f-75bd-46da-b298-d88ab7eee15f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:51.570307 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6770366f-75bd-46da-b298-d88ab7eee15f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:51.570847 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6770366f-75bd-46da-b298-d88ab7eee15f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:51.571744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6770366f-75bd-46da-b298-d88ab7eee15f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:51.572176 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6770366f-75bd-46da-b298-d88ab7eee15f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:51.621103 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-187ea762-64e1-4028-8a52-69fcf1c7cd73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:51.630623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-187ea762-64e1-4028-8a52-69fcf1c7cd73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:51.632253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-187ea762-64e1-4028-8a52-69fcf1c7cd73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:51.633482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-187ea762-64e1-4028-8a52-69fcf1c7cd73 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1286 microversion: 2.20 time: 0.223422 Aug 19 09:17:51.643522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 48/109] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:51 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1286 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:51.696683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6770366f-75bd-46da-b298-d88ab7eee15f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:51.704304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6770366f-75bd-46da-b298-d88ab7eee15f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.145578 Aug 19 09:17:51.704863 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 62/110] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:51 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:17:51.729102 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-177dbf23-0e34-40a6-a1ed-23b6a3287975 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:51.729714 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-177dbf23-0e34-40a6-a1ed-23b6a3287975 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:51.736310 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-177dbf23-0e34-40a6-a1ed-23b6a3287975 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:51.736762 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-177dbf23-0e34-40a6-a1ed-23b6a3287975 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:51.737533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-177dbf23-0e34-40a6-a1ed-23b6a3287975 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:51.737969 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-177dbf23-0e34-40a6-a1ed-23b6a3287975 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:51.799560 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-177dbf23-0e34-40a6-a1ed-23b6a3287975 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:51.807022 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-177dbf23-0e34-40a6-a1ed-23b6a3287975 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1226 microversion: 2.1 time: 0.081406 Aug 19 09:17:51.807619 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 49/111] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:51 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:51.960027 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0c4ef6c4-9e9a-4a62-8e63-ed99105737bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:51.960629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0c4ef6c4-9e9a-4a62-8e63-ed99105737bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:51.967053 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c4ef6c4-9e9a-4a62-8e63-ed99105737bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:51.967520 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c4ef6c4-9e9a-4a62-8e63-ed99105737bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:51.968278 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c4ef6c4-9e9a-4a62-8e63-ed99105737bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:51.968702 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c4ef6c4-9e9a-4a62-8e63-ed99105737bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:52.095655 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0c4ef6c4-9e9a-4a62-8e63-ed99105737bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:52.103067 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0c4ef6c4-9e9a-4a62-8e63-ed99105737bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.146650 Aug 19 09:17:52.103643 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 63/112] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:51 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:52.653925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b4eb3e65-bced-4083-aa15-0d33a176f7c9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:52.654804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b4eb3e65-bced-4083-aa15-0d33a176f7c9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:52.663982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b4eb3e65-bced-4083-aa15-0d33a176f7c9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:52.666262 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b4eb3e65-bced-4083-aa15-0d33a176f7c9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:52.670181 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b4eb3e65-bced-4083-aa15-0d33a176f7c9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:52.670720 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b4eb3e65-bced-4083-aa15-0d33a176f7c9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:52.720911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-609a3ae0-88c6-46be-96d9-83db1f6b4a2f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:52.721544 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-609a3ae0-88c6-46be-96d9-83db1f6b4a2f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:52.729646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-609a3ae0-88c6-46be-96d9-83db1f6b4a2f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:52.737000 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-609a3ae0-88c6-46be-96d9-83db1f6b4a2f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:52.738226 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-609a3ae0-88c6-46be-96d9-83db1f6b4a2f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:52.741900 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-609a3ae0-88c6-46be-96d9-83db1f6b4a2f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:52.763681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b4eb3e65-bced-4083-aa15-0d33a176f7c9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:52.807370 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b4eb3e65-bced-4083-aa15-0d33a176f7c9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:52.811806 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b4eb3e65-bced-4083-aa15-0d33a176f7c9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:52.813141 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b4eb3e65-bced-4083-aa15-0d33a176f7c9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1278 microversion: 2.20 time: 0.163800 Aug 19 09:17:52.813698 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 50/113] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:52 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:52.828206 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f4a46b6f-fd81-4ca2-8824-670d0a956af4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:52.829717 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f4a46b6f-fd81-4ca2-8824-670d0a956af4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:52.842799 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f4a46b6f-fd81-4ca2-8824-670d0a956af4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:52.843253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f4a46b6f-fd81-4ca2-8824-670d0a956af4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:52.844061 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f4a46b6f-fd81-4ca2-8824-670d0a956af4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:52.844493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f4a46b6f-fd81-4ca2-8824-670d0a956af4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:52.917815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-609a3ae0-88c6-46be-96d9-83db1f6b4a2f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:52.930354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-609a3ae0-88c6-46be-96d9-83db1f6b4a2f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.213763 Aug 19 09:17:52.930928 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 64/114] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:52 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:17:52.936254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f4a46b6f-fd81-4ca2-8824-670d0a956af4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:52.945145 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f4a46b6f-fd81-4ca2-8824-670d0a956af4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1218 microversion: 2.1 time: 0.124756 Aug 19 09:17:52.946375 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 51/115] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:52 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:53.123691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8077a7fa-9e11-47a4-a931-3dae9ee9f196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:53.125491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8077a7fa-9e11-47a4-a931-3dae9ee9f196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:53.138745 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8077a7fa-9e11-47a4-a931-3dae9ee9f196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:53.139190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8077a7fa-9e11-47a4-a931-3dae9ee9f196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:53.140068 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8077a7fa-9e11-47a4-a931-3dae9ee9f196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:53.140503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8077a7fa-9e11-47a4-a931-3dae9ee9f196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:53.831853 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-96ab2721-478f-45b0-b0e6-48afeadcdc98 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:53.832456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-96ab2721-478f-45b0-b0e6-48afeadcdc98 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:53.839813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-96ab2721-478f-45b0-b0e6-48afeadcdc98 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:53.841615 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-96ab2721-478f-45b0-b0e6-48afeadcdc98 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:53.843004 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-96ab2721-478f-45b0-b0e6-48afeadcdc98 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:53.845288 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-96ab2721-478f-45b0-b0e6-48afeadcdc98 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:53.877506 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8077a7fa-9e11-47a4-a931-3dae9ee9f196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:53.887342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8077a7fa-9e11-47a4-a931-3dae9ee9f196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.768818 Aug 19 09:17:53.897269 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 65/116] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:53 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:53.949730 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6ed9d42a-776b-455a-b5d8-71afdb45cd33 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:53.949919 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6ed9d42a-776b-455a-b5d8-71afdb45cd33 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:53.953525 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-96ab2721-478f-45b0-b0e6-48afeadcdc98 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:53.960580 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6ed9d42a-776b-455a-b5d8-71afdb45cd33 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:53.961386 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6ed9d42a-776b-455a-b5d8-71afdb45cd33 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:53.961857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-96ab2721-478f-45b0-b0e6-48afeadcdc98 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:53.963336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6ed9d42a-776b-455a-b5d8-71afdb45cd33 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:53.963790 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6ed9d42a-776b-455a-b5d8-71afdb45cd33 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:53.971515 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-96ab2721-478f-45b0-b0e6-48afeadcdc98 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:53.974938 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-96ab2721-478f-45b0-b0e6-48afeadcdc98 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1340 microversion: 2.20 time: 0.146869 Aug 19 09:17:53.977888 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 52/117] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:53 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1340 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:53.991594 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9277995f-9061-44c7-87a9-09deb4bc3294 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:53.992462 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9277995f-9061-44c7-87a9-09deb4bc3294 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:54.010301 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9277995f-9061-44c7-87a9-09deb4bc3294 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:54.011254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9277995f-9061-44c7-87a9-09deb4bc3294 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:54.014317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9277995f-9061-44c7-87a9-09deb4bc3294 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:54.015510 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9277995f-9061-44c7-87a9-09deb4bc3294 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:54.174707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9277995f-9061-44c7-87a9-09deb4bc3294 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:54.187904 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9277995f-9061-44c7-87a9-09deb4bc3294 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1292 microversion: 2.1 time: 0.207210 Aug 19 09:17:54.188931 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 53/118] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:53 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1292 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:54.562226 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6ed9d42a-776b-455a-b5d8-71afdb45cd33 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:54.571307 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6ed9d42a-776b-455a-b5d8-71afdb45cd33 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.626886 Aug 19 09:17:54.571886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 66/119] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:53 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:17:54.593187 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-48b28e0c-a088-453b-97e4-9834fcdc29c6 req-a45c49b0-6268-44e9-b47e-2d67172c0d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728c5e2b-27f2-4879-b35b-7b814e6dca52", "tag": "d13f978a-34d4-4492-ad11-9cefbdb91dcc"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:54.598702 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:17:54.598702 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:17:54.611568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-48b28e0c-a088-453b-97e4-9834fcdc29c6 req-a45c49b0-6268-44e9-b47e-2d67172c0d33 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:54.612010 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-48b28e0c-a088-453b-97e4-9834fcdc29c6 req-a45c49b0-6268-44e9-b47e-2d67172c0d33 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:54.631626 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-48b28e0c-a088-453b-97e4-9834fcdc29c6 req-a45c49b0-6268-44e9-b47e-2d67172c0d33 service nova] Creating event network-changed:d13f978a-34d4-4492-ad11-9cefbdb91dcc for instance 728c5e2b-27f2-4879-b35b-7b814e6dca52 on hv-cinder-77387 Aug 19 09:17:54.632131 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-48b28e0c-a088-453b-97e4-9834fcdc29c6 req-a45c49b0-6268-44e9-b47e-2d67172c0d33 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107958) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 19 09:17:54.633237 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e9df60c-c1d9-486e-b832-fe6c0b323aba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:54.633678 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e9df60c-c1d9-486e-b832-fe6c0b323aba None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:54.634691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e9df60c-c1d9-486e-b832-fe6c0b323aba None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:54.635368 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e9df60c-c1d9-486e-b832-fe6c0b323aba None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:54.646760 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.compute.rpcapi [None req-9e9df60c-c1d9-486e-b832-fe6c0b323aba None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 19 09:17:54.647759 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e9df60c-c1d9-486e-b832-fe6c0b323aba None None] Releasing lock "compute-rpcapi-router" {{(pid=107958) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 19 09:17:54.675994 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9e9df60c-c1d9-486e-b832-fe6c0b323aba None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160102 Aug 19 09:17:54.676773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 54/120] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:17:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:17:54.903993 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3836a27a-7efe-4ebc-8862-bf84a1c2b91b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:54.904589 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3836a27a-7efe-4ebc-8862-bf84a1c2b91b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:54.910583 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3836a27a-7efe-4ebc-8862-bf84a1c2b91b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:54.911032 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3836a27a-7efe-4ebc-8862-bf84a1c2b91b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:54.911833 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3836a27a-7efe-4ebc-8862-bf84a1c2b91b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:54.912270 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3836a27a-7efe-4ebc-8862-bf84a1c2b91b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:54.997818 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ee4c1dbf-7a8c-450c-8f44-80b0169fb6d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:54.998719 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ee4c1dbf-7a8c-450c-8f44-80b0169fb6d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:55.005148 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee4c1dbf-7a8c-450c-8f44-80b0169fb6d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:55.005604 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee4c1dbf-7a8c-450c-8f44-80b0169fb6d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:55.006440 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee4c1dbf-7a8c-450c-8f44-80b0169fb6d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:55.006960 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee4c1dbf-7a8c-450c-8f44-80b0169fb6d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:55.079497 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ee4c1dbf-7a8c-450c-8f44-80b0169fb6d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:55.087370 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ee4c1dbf-7a8c-450c-8f44-80b0169fb6d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:55.088865 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ee4c1dbf-7a8c-450c-8f44-80b0169fb6d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:55.089959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ee4c1dbf-7a8c-450c-8f44-80b0169fb6d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1340 microversion: 2.20 time: 0.097062 Aug 19 09:17:55.090490 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 55/121] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:54 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:17:55.205704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3363d1e2-075c-4abb-a82b-a01f904a920b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:55.206658 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3363d1e2-075c-4abb-a82b-a01f904a920b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:55.220904 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3363d1e2-075c-4abb-a82b-a01f904a920b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:55.221317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3363d1e2-075c-4abb-a82b-a01f904a920b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:55.222176 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3363d1e2-075c-4abb-a82b-a01f904a920b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:55.222536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3363d1e2-075c-4abb-a82b-a01f904a920b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:55.352979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3363d1e2-075c-4abb-a82b-a01f904a920b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:55.363902 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3363d1e2-075c-4abb-a82b-a01f904a920b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1280 microversion: 2.1 time: 0.162156 Aug 19 09:17:55.364632 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 56/122] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:55 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:55.398041 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3836a27a-7efe-4ebc-8862-bf84a1c2b91b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:55.408526 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3836a27a-7efe-4ebc-8862-bf84a1c2b91b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.506062 Aug 19 09:17:55.409836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 67/123] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:54 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:55.437888 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-b5cc5d4a-cbb6-4f5d-ae76-2d4b845943be req-a5797099-4266-4a2c-b0db-caa764ee20f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d8a445-b5d9-4394-955e-6b57dda71720", "tag": "fe32dc17-332d-4b18-91b9-52ea978ffebd"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:55.440569 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:17:55.440569 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:17:55.448538 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-b5cc5d4a-cbb6-4f5d-ae76-2d4b845943be req-a5797099-4266-4a2c-b0db-caa764ee20f5 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:55.449125 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-b5cc5d4a-cbb6-4f5d-ae76-2d4b845943be req-a5797099-4266-4a2c-b0db-caa764ee20f5 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:55.460937 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-b5cc5d4a-cbb6-4f5d-ae76-2d4b845943be req-a5797099-4266-4a2c-b0db-caa764ee20f5 service nova] Creating event network-changed:fe32dc17-332d-4b18-91b9-52ea978ffebd for instance e7d8a445-b5d9-4394-955e-6b57dda71720 on hv-cinder-77387 Aug 19 09:17:55.467928 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-b5cc5d4a-cbb6-4f5d-ae76-2d4b845943be req-a5797099-4266-4a2c-b0db-caa764ee20f5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101479 Aug 19 09:17:55.469008 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 57/124] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:17:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:55.588562 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f3ddfe94-b537-456e-a14a-ba54bfc47b0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:55.591061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f3ddfe94-b537-456e-a14a-ba54bfc47b0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:55.604299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3ddfe94-b537-456e-a14a-ba54bfc47b0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:55.614115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3ddfe94-b537-456e-a14a-ba54bfc47b0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:55.615325 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3ddfe94-b537-456e-a14a-ba54bfc47b0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:55.616065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3ddfe94-b537-456e-a14a-ba54bfc47b0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:55.890828 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f3ddfe94-b537-456e-a14a-ba54bfc47b0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:55.904036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f3ddfe94-b537-456e-a14a-ba54bfc47b0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.318799 Aug 19 09:17:55.914691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 68/125] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:55 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:56.111814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-33525342-9d31-440e-b1c3-a1fad82b0cab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:56.113322 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-33525342-9d31-440e-b1c3-a1fad82b0cab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:56.142630 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33525342-9d31-440e-b1c3-a1fad82b0cab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.143087 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33525342-9d31-440e-b1c3-a1fad82b0cab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:56.143892 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33525342-9d31-440e-b1c3-a1fad82b0cab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.144406 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33525342-9d31-440e-b1c3-a1fad82b0cab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:56.336802 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-33525342-9d31-440e-b1c3-a1fad82b0cab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:56.347288 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-33525342-9d31-440e-b1c3-a1fad82b0cab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:56.353242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-33525342-9d31-440e-b1c3-a1fad82b0cab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:56.354642 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-33525342-9d31-440e-b1c3-a1fad82b0cab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.249204 Aug 19 09:17:56.355742 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 58/126] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:56 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:56.384297 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-93a4fee3-82f1-4870-9902-7f690713b454 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:56.385507 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-93a4fee3-82f1-4870-9902-7f690713b454 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:56.396069 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93a4fee3-82f1-4870-9902-7f690713b454 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.396526 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93a4fee3-82f1-4870-9902-7f690713b454 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:56.401797 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93a4fee3-82f1-4870-9902-7f690713b454 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.402495 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93a4fee3-82f1-4870-9902-7f690713b454 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:56.427036 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5dd34492-90ce-429e-bb94-8013daf0f0d5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:56.428007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5dd34492-90ce-429e-bb94-8013daf0f0d5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:56.440317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5dd34492-90ce-429e-bb94-8013daf0f0d5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.441081 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5dd34492-90ce-429e-bb94-8013daf0f0d5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:56.441816 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5dd34492-90ce-429e-bb94-8013daf0f0d5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.442317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5dd34492-90ce-429e-bb94-8013daf0f0d5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:56.491019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-93a4fee3-82f1-4870-9902-7f690713b454 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:56.502893 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-93a4fee3-82f1-4870-9902-7f690713b454 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1280 microversion: 2.1 time: 0.123035 Aug 19 09:17:56.513216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 69/127] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:56 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:56.635746 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5dd34492-90ce-429e-bb94-8013daf0f0d5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:56.646380 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5dd34492-90ce-429e-bb94-8013daf0f0d5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.222986 Aug 19 09:17:56.657955 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 59/128] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:56 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:56.700401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-b66444e7-f151-4a7d-bd2c-e48b3c0c60d2 req-9339f6a8-8a13-4ddf-b0f6-38e6778427be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c3bc8f-45ae-4a40-8a3d-d9642d8728df", "tag": "ac485851-543b-4b61-ba46-32cc68fcf2c4"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:56.705504 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:17:56.705504 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:17:56.719360 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-b66444e7-f151-4a7d-bd2c-e48b3c0c60d2 req-9339f6a8-8a13-4ddf-b0f6-38e6778427be service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.720135 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-b66444e7-f151-4a7d-bd2c-e48b3c0c60d2 req-9339f6a8-8a13-4ddf-b0f6-38e6778427be service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:56.743842 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-b66444e7-f151-4a7d-bd2c-e48b3c0c60d2 req-9339f6a8-8a13-4ddf-b0f6-38e6778427be service nova] Creating event network-changed:ac485851-543b-4b61-ba46-32cc68fcf2c4 for instance f4c3bc8f-45ae-4a40-8a3d-d9642d8728df on hv-cinder-77387 Aug 19 09:17:56.744755 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-b66444e7-f151-4a7d-bd2c-e48b3c0c60d2 req-9339f6a8-8a13-4ddf-b0f6-38e6778427be service nova] Acquired lock "compute-rpcapi-router" {{(pid=107957) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 19 09:17:56.746035 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c7cd560-1e1d-4fd0-953b-42ddc1c0f8c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.746628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c7cd560-1e1d-4fd0-953b-42ddc1c0f8c5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:56.749058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c7cd560-1e1d-4fd0-953b-42ddc1c0f8c5 None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.749650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c7cd560-1e1d-4fd0-953b-42ddc1c0f8c5 None None] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:56.759906 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.compute.rpcapi [None req-4c7cd560-1e1d-4fd0-953b-42ddc1c0f8c5 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 19 09:17:56.761010 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c7cd560-1e1d-4fd0-953b-42ddc1c0f8c5 None None] Releasing lock "compute-rpcapi-router" {{(pid=107957) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 19 09:17:56.789401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4c7cd560-1e1d-4fd0-953b-42ddc1c0f8c5 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094311 Aug 19 09:17:56.790295 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 70/129] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:17:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:17:56.922449 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-63fcfbea-4fd8-4fc4-a9db-3c52e151b8a5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:56.923241 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-63fcfbea-4fd8-4fc4-a9db-3c52e151b8a5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:56.929271 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-63fcfbea-4fd8-4fc4-a9db-3c52e151b8a5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.929801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-63fcfbea-4fd8-4fc4-a9db-3c52e151b8a5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:56.930640 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-63fcfbea-4fd8-4fc4-a9db-3c52e151b8a5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:56.931145 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-63fcfbea-4fd8-4fc4-a9db-3c52e151b8a5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:57.078869 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-63fcfbea-4fd8-4fc4-a9db-3c52e151b8a5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:57.087729 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-63fcfbea-4fd8-4fc4-a9db-3c52e151b8a5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.168853 Aug 19 09:17:57.098750 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 60/130] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:56 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:57.381048 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0d18f024-9ba5-4c74-8126-070d3b68197d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:57.382362 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0d18f024-9ba5-4c74-8126-070d3b68197d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:57.390554 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d18f024-9ba5-4c74-8126-070d3b68197d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:57.391158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d18f024-9ba5-4c74-8126-070d3b68197d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:57.392206 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d18f024-9ba5-4c74-8126-070d3b68197d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:57.392813 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d18f024-9ba5-4c74-8126-070d3b68197d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:57.522482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-816460ba-0d73-4915-8c62-44aca9fc4d2f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:57.525691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-816460ba-0d73-4915-8c62-44aca9fc4d2f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:57.537884 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-816460ba-0d73-4915-8c62-44aca9fc4d2f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:57.539482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-816460ba-0d73-4915-8c62-44aca9fc4d2f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:57.540314 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-816460ba-0d73-4915-8c62-44aca9fc4d2f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:57.540785 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-816460ba-0d73-4915-8c62-44aca9fc4d2f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:57.553584 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0d18f024-9ba5-4c74-8126-070d3b68197d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:57.562890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0d18f024-9ba5-4c74-8126-070d3b68197d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:57.566085 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0d18f024-9ba5-4c74-8126-070d3b68197d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:57.567536 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0d18f024-9ba5-4c74-8126-070d3b68197d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.197664 Aug 19 09:17:57.569654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 71/131] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:57 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:57.622254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-816460ba-0d73-4915-8c62-44aca9fc4d2f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:57.631653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-816460ba-0d73-4915-8c62-44aca9fc4d2f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1280 microversion: 2.1 time: 0.114752 Aug 19 09:17:57.633431 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 61/132] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:57 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1280 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:57.663971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d418f635-a51c-4970-acac-d7976f5ee39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:57.664782 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d418f635-a51c-4970-acac-d7976f5ee39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:57.671198 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d418f635-a51c-4970-acac-d7976f5ee39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:57.671954 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d418f635-a51c-4970-acac-d7976f5ee39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:57.672889 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d418f635-a51c-4970-acac-d7976f5ee39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:57.673464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d418f635-a51c-4970-acac-d7976f5ee39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:57.875761 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d418f635-a51c-4970-acac-d7976f5ee39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:57.883293 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d418f635-a51c-4970-acac-d7976f5ee39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.222888 Aug 19 09:17:57.883860 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 72/133] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:57 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:58.107510 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-626d6b8f-3b77-4dc6-8064-41aed0f699dc tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:58.108775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-626d6b8f-3b77-4dc6-8064-41aed0f699dc tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:58.124915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-626d6b8f-3b77-4dc6-8064-41aed0f699dc tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:58.124915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-626d6b8f-3b77-4dc6-8064-41aed0f699dc tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:58.124915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-626d6b8f-3b77-4dc6-8064-41aed0f699dc tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:58.124915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-626d6b8f-3b77-4dc6-8064-41aed0f699dc tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:58.249535 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-626d6b8f-3b77-4dc6-8064-41aed0f699dc tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:58.256777 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-626d6b8f-3b77-4dc6-8064-41aed0f699dc tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.155571 Aug 19 09:17:58.257336 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 62/134] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:58 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:58.587578 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-072d2b11-20ad-4ee8-ab32-8f5943c6d729 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:58.588797 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-072d2b11-20ad-4ee8-ab32-8f5943c6d729 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:58.599748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-072d2b11-20ad-4ee8-ab32-8f5943c6d729 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:58.599748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-072d2b11-20ad-4ee8-ab32-8f5943c6d729 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:58.599748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-072d2b11-20ad-4ee8-ab32-8f5943c6d729 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:58.599748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-072d2b11-20ad-4ee8-ab32-8f5943c6d729 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:58.656250 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1373df03-f011-4f6c-816d-1850eb1ce69f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:58.656882 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1373df03-f011-4f6c-816d-1850eb1ce69f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:58.662766 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1373df03-f011-4f6c-816d-1850eb1ce69f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:58.664201 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1373df03-f011-4f6c-816d-1850eb1ce69f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:58.665011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1373df03-f011-4f6c-816d-1850eb1ce69f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:58.665457 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1373df03-f011-4f6c-816d-1850eb1ce69f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:58.825520 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1373df03-f011-4f6c-816d-1850eb1ce69f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:58.836999 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1373df03-f011-4f6c-816d-1850eb1ce69f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1280 microversion: 2.1 time: 0.185484 Aug 19 09:17:58.847548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 63/135] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:58 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1280 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:58.906616 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ea16e756-a3f6-4a6e-8826-9403e21c8a5c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:58.907823 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ea16e756-a3f6-4a6e-8826-9403e21c8a5c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:58.915961 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ea16e756-a3f6-4a6e-8826-9403e21c8a5c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:58.916888 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ea16e756-a3f6-4a6e-8826-9403e21c8a5c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:58.918765 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ea16e756-a3f6-4a6e-8826-9403e21c8a5c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:58.919917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ea16e756-a3f6-4a6e-8826-9403e21c8a5c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:58.928268 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-072d2b11-20ad-4ee8-ab32-8f5943c6d729 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:58.939656 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-072d2b11-20ad-4ee8-ab32-8f5943c6d729 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:58.945428 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-072d2b11-20ad-4ee8-ab32-8f5943c6d729 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:58.946606 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-072d2b11-20ad-4ee8-ab32-8f5943c6d729 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.362624 Aug 19 09:17:58.947185 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 73/136] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:58 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:17:59.275108 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8c2c7d7d-b5b8-4854-91d3-0e10ccc5ba5e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:59.275743 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8c2c7d7d-b5b8-4854-91d3-0e10ccc5ba5e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:59.292241 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c2c7d7d-b5b8-4854-91d3-0e10ccc5ba5e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:59.295678 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c2c7d7d-b5b8-4854-91d3-0e10ccc5ba5e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:59.297056 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c2c7d7d-b5b8-4854-91d3-0e10ccc5ba5e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:59.297828 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c2c7d7d-b5b8-4854-91d3-0e10ccc5ba5e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:59.506093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ea16e756-a3f6-4a6e-8826-9403e21c8a5c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:59.519694 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ea16e756-a3f6-4a6e-8826-9403e21c8a5c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.618820 Aug 19 09:17:59.520641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 64/137] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:58 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:17:59.845451 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8c2c7d7d-b5b8-4854-91d3-0e10ccc5ba5e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:17:59.854063 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0de1d042-d39f-4e12-8ae1-d501f4da99c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:17:59.857344 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0de1d042-d39f-4e12-8ae1-d501f4da99c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:17:59.870767 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0de1d042-d39f-4e12-8ae1-d501f4da99c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:59.872630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8c2c7d7d-b5b8-4854-91d3-0e10ccc5ba5e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.600993 Aug 19 09:17:59.873664 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0de1d042-d39f-4e12-8ae1-d501f4da99c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:59.876333 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 74/138] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:59 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:17:59.876876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0de1d042-d39f-4e12-8ae1-d501f4da99c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:59.877940 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0de1d042-d39f-4e12-8ae1-d501f4da99c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:59.905242 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-59b883c3-a921-4bf0-89c6-ecb20064e1e6 req-5b2bb3fd-2773-4081-b1d7-d65b28abc581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed06d0a-7ee6-4f00-b470-b19d7331667c", "tag": "137293e7-3590-4eee-8e9a-b01076e25605"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:17:59.909907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:17:59.909907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:17:59.961909 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-59b883c3-a921-4bf0-89c6-ecb20064e1e6 req-5b2bb3fd-2773-4081-b1d7-d65b28abc581 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:17:59.962392 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-59b883c3-a921-4bf0-89c6-ecb20064e1e6 req-5b2bb3fd-2773-4081-b1d7-d65b28abc581 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:17:59.982701 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-59b883c3-a921-4bf0-89c6-ecb20064e1e6 req-5b2bb3fd-2773-4081-b1d7-d65b28abc581 service nova] Creating event network-changed:137293e7-3590-4eee-8e9a-b01076e25605 for instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c on hv-cinder-77387 Aug 19 09:17:59.989752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-59b883c3-a921-4bf0-89c6-ecb20064e1e6 req-5b2bb3fd-2773-4081-b1d7-d65b28abc581 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092733 Aug 19 09:17:59.994790 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 75/139] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:17:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:18:00.007536 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cda04c18-ac70-4175-8ac1-b3968f9301c6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:00.008973 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cda04c18-ac70-4175-8ac1-b3968f9301c6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:00.027427 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cda04c18-ac70-4175-8ac1-b3968f9301c6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:00.029187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cda04c18-ac70-4175-8ac1-b3968f9301c6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:00.031353 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cda04c18-ac70-4175-8ac1-b3968f9301c6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:00.032632 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cda04c18-ac70-4175-8ac1-b3968f9301c6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:00.498799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cda04c18-ac70-4175-8ac1-b3968f9301c6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:00.517671 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cda04c18-ac70-4175-8ac1-b3968f9301c6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:00.519236 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cda04c18-ac70-4175-8ac1-b3968f9301c6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:00.520389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cda04c18-ac70-4175-8ac1-b3968f9301c6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.522646 Aug 19 09:18:00.520976 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 76/140] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:17:59 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:00.537754 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ce031da1-084a-4bc8-b614-cdf5ae4351fe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:00.538474 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ce031da1-084a-4bc8-b614-cdf5ae4351fe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:00.549042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ce031da1-084a-4bc8-b614-cdf5ae4351fe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:00.549493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ce031da1-084a-4bc8-b614-cdf5ae4351fe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:00.550294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ce031da1-084a-4bc8-b614-cdf5ae4351fe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:00.555211 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ce031da1-084a-4bc8-b614-cdf5ae4351fe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:00.835624 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0de1d042-d39f-4e12-8ae1-d501f4da99c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:00.844116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0de1d042-d39f-4e12-8ae1-d501f4da99c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.994861 Aug 19 09:18:00.846886 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 65/141] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:17:59 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:00.892112 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0324e3a2-4af9-40df-921e-8fa4199a2868 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:00.893477 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0324e3a2-4af9-40df-921e-8fa4199a2868 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:00.903387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0324e3a2-4af9-40df-921e-8fa4199a2868 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:00.904026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0324e3a2-4af9-40df-921e-8fa4199a2868 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:00.906583 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0324e3a2-4af9-40df-921e-8fa4199a2868 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:00.907167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0324e3a2-4af9-40df-921e-8fa4199a2868 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:01.022129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ce031da1-084a-4bc8-b614-cdf5ae4351fe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:01.032465 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ce031da1-084a-4bc8-b614-cdf5ae4351fe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.498226 Aug 19 09:18:01.033578 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 77/142] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:00 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:01.346899 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0324e3a2-4af9-40df-921e-8fa4199a2868 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:01.361113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0324e3a2-4af9-40df-921e-8fa4199a2868 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.472403 Aug 19 09:18:01.370289 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 66/143] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:00 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:01.539058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a5eb8ed5-cebd-4b0f-8dc0-ac781a3e6e77 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:01.539732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a5eb8ed5-cebd-4b0f-8dc0-ac781a3e6e77 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:01.546066 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5eb8ed5-cebd-4b0f-8dc0-ac781a3e6e77 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:01.546517 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5eb8ed5-cebd-4b0f-8dc0-ac781a3e6e77 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:01.547305 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5eb8ed5-cebd-4b0f-8dc0-ac781a3e6e77 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:01.547818 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5eb8ed5-cebd-4b0f-8dc0-ac781a3e6e77 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:01.686665 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a5eb8ed5-cebd-4b0f-8dc0-ac781a3e6e77 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:01.696229 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a5eb8ed5-cebd-4b0f-8dc0-ac781a3e6e77 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:01.698035 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a5eb8ed5-cebd-4b0f-8dc0-ac781a3e6e77 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:01.699544 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a5eb8ed5-cebd-4b0f-8dc0-ac781a3e6e77 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.164200 Aug 19 09:18:01.700467 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 78/144] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:01 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:01.863739 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ad9ec3b1-5734-498a-9f04-4c064e84e57b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:01.864587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ad9ec3b1-5734-498a-9f04-4c064e84e57b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:01.877044 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ad9ec3b1-5734-498a-9f04-4c064e84e57b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:01.877805 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ad9ec3b1-5734-498a-9f04-4c064e84e57b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:01.878886 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ad9ec3b1-5734-498a-9f04-4c064e84e57b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:01.879698 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ad9ec3b1-5734-498a-9f04-4c064e84e57b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:02.052296 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4b1bf7fa-f312-41f8-b7b9-aa964d611631 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:02.053878 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4b1bf7fa-f312-41f8-b7b9-aa964d611631 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:02.062781 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b1bf7fa-f312-41f8-b7b9-aa964d611631 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:02.063882 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b1bf7fa-f312-41f8-b7b9-aa964d611631 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:02.065823 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b1bf7fa-f312-41f8-b7b9-aa964d611631 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:02.066618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b1bf7fa-f312-41f8-b7b9-aa964d611631 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:02.269572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4b1bf7fa-f312-41f8-b7b9-aa964d611631 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:02.276620 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4b1bf7fa-f312-41f8-b7b9-aa964d611631 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.230342 Aug 19 09:18:02.286914 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 79/145] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:02 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:02.292500 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-1f2af731-42f4-455d-a47b-8517ca9cfc5d req-8871ce29-ae39-4f5d-9337-da3e93065df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf", "tag": "0012aba4-1975-4e17-9e36-63ccd5b799da"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:18:02.294745 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:18:02.294745 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:18:02.303710 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-1f2af731-42f4-455d-a47b-8517ca9cfc5d req-8871ce29-ae39-4f5d-9337-da3e93065df2 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:02.304521 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-1f2af731-42f4-455d-a47b-8517ca9cfc5d req-8871ce29-ae39-4f5d-9337-da3e93065df2 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:02.319842 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-1f2af731-42f4-455d-a47b-8517ca9cfc5d req-8871ce29-ae39-4f5d-9337-da3e93065df2 service nova] Creating event network-changed:0012aba4-1975-4e17-9e36-63ccd5b799da for instance ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf on hv-cinder-77387 Aug 19 09:18:02.329366 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-1f2af731-42f4-455d-a47b-8517ca9cfc5d req-8871ce29-ae39-4f5d-9337-da3e93065df2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040694 Aug 19 09:18:02.330123 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 80/146] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:18:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:18:02.383864 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-15821535-85f4-4c7b-a40f-8180d1992997 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:02.384875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-15821535-85f4-4c7b-a40f-8180d1992997 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:02.392451 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-15821535-85f4-4c7b-a40f-8180d1992997 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:02.393229 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-15821535-85f4-4c7b-a40f-8180d1992997 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:02.394329 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-15821535-85f4-4c7b-a40f-8180d1992997 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:02.395037 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-15821535-85f4-4c7b-a40f-8180d1992997 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:02.415861 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ad9ec3b1-5734-498a-9f04-4c064e84e57b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:02.425367 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ad9ec3b1-5734-498a-9f04-4c064e84e57b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.564419 Aug 19 09:18:02.425949 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 67/147] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:01 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:02.570330 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-15821535-85f4-4c7b-a40f-8180d1992997 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:02.583937 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-15821535-85f4-4c7b-a40f-8180d1992997 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.209092 Aug 19 09:18:02.584852 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 81/148] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:02 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:02.720730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7166e6a1-7bb9-4075-adec-64dc6ca07444 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:02.721365 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7166e6a1-7bb9-4075-adec-64dc6ca07444 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:02.729084 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7166e6a1-7bb9-4075-adec-64dc6ca07444 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:02.729543 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7166e6a1-7bb9-4075-adec-64dc6ca07444 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:02.734575 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7166e6a1-7bb9-4075-adec-64dc6ca07444 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:02.744446 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7166e6a1-7bb9-4075-adec-64dc6ca07444 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:02.881801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7166e6a1-7bb9-4075-adec-64dc6ca07444 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:02.891668 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7166e6a1-7bb9-4075-adec-64dc6ca07444 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:02.893283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7166e6a1-7bb9-4075-adec-64dc6ca07444 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:02.894707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7166e6a1-7bb9-4075-adec-64dc6ca07444 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.180704 Aug 19 09:18:02.895932 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 68/149] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:02 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:03.294194 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-89a469a7-a660-4eb0-b228-b4f92552e3ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:03.294994 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-89a469a7-a660-4eb0-b228-b4f92552e3ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:03.301213 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89a469a7-a660-4eb0-b228-b4f92552e3ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:03.301658 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89a469a7-a660-4eb0-b228-b4f92552e3ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:03.302420 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89a469a7-a660-4eb0-b228-b4f92552e3ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:03.302848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89a469a7-a660-4eb0-b228-b4f92552e3ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:03.443806 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-89a469a7-a660-4eb0-b228-b4f92552e3ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:03.447540 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-61ac8244-9c3e-4de4-a42d-5b36552114db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:03.448221 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-61ac8244-9c3e-4de4-a42d-5b36552114db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:03.454314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-89a469a7-a660-4eb0-b228-b4f92552e3ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.164304 Aug 19 09:18:03.463524 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 82/150] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:03 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:03.463659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-61ac8244-9c3e-4de4-a42d-5b36552114db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:03.463659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-61ac8244-9c3e-4de4-a42d-5b36552114db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:03.463659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-61ac8244-9c3e-4de4-a42d-5b36552114db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:03.463659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-61ac8244-9c3e-4de4-a42d-5b36552114db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:03.594815 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-61ac8244-9c3e-4de4-a42d-5b36552114db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:03.599928 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-bd429c4a-9532-4e04-badd-ba39c60d3dd7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:03.600550 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-bd429c4a-9532-4e04-badd-ba39c60d3dd7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:03.611537 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-61ac8244-9c3e-4de4-a42d-5b36552114db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.173197 Aug 19 09:18:03.613327 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd429c4a-9532-4e04-badd-ba39c60d3dd7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:03.613969 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd429c4a-9532-4e04-badd-ba39c60d3dd7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:03.614938 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd429c4a-9532-4e04-badd-ba39c60d3dd7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:03.615591 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd429c4a-9532-4e04-badd-ba39c60d3dd7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:03.619208 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 69/151] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:03 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:03.768910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-bd429c4a-9532-4e04-badd-ba39c60d3dd7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:03.776563 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-bd429c4a-9532-4e04-badd-ba39c60d3dd7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.180456 Aug 19 09:18:03.777523 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 83/152] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:03 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:03.912236 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-90952bf7-1ee8-4fca-a68f-ce06dae4aabd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:03.912767 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-90952bf7-1ee8-4fca-a68f-ce06dae4aabd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:03.918402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-90952bf7-1ee8-4fca-a68f-ce06dae4aabd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:03.919451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-90952bf7-1ee8-4fca-a68f-ce06dae4aabd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:03.920382 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-90952bf7-1ee8-4fca-a68f-ce06dae4aabd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:03.920803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-90952bf7-1ee8-4fca-a68f-ce06dae4aabd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:04.058749 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-90952bf7-1ee8-4fca-a68f-ce06dae4aabd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:04.068417 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-90952bf7-1ee8-4fca-a68f-ce06dae4aabd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:04.069947 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-90952bf7-1ee8-4fca-a68f-ce06dae4aabd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:04.071039 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-90952bf7-1ee8-4fca-a68f-ce06dae4aabd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.162510 Aug 19 09:18:04.071915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 70/153] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:03 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:04.470381 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3b178ffb-5dc3-4ff6-95c1-0d3b175dc5d4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:04.471034 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3b178ffb-5dc3-4ff6-95c1-0d3b175dc5d4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:04.476884 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b178ffb-5dc3-4ff6-95c1-0d3b175dc5d4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:04.477320 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b178ffb-5dc3-4ff6-95c1-0d3b175dc5d4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:04.478068 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b178ffb-5dc3-4ff6-95c1-0d3b175dc5d4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:04.478494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b178ffb-5dc3-4ff6-95c1-0d3b175dc5d4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:04.599009 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3b178ffb-5dc3-4ff6-95c1-0d3b175dc5d4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:04.606406 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3b178ffb-5dc3-4ff6-95c1-0d3b175dc5d4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.139534 Aug 19 09:18:04.607050 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 84/154] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:04 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:04.635219 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-17d55836-667e-42c1-8a38-1f68aaafa50a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:04.635852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-17d55836-667e-42c1-8a38-1f68aaafa50a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:04.642054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-17d55836-667e-42c1-8a38-1f68aaafa50a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:04.642494 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-17d55836-667e-42c1-8a38-1f68aaafa50a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:04.643251 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-17d55836-667e-42c1-8a38-1f68aaafa50a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:04.643706 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-17d55836-667e-42c1-8a38-1f68aaafa50a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:04.793928 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6c4025bf-badc-422a-8d4a-b9de2c54878c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:04.794525 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6c4025bf-badc-422a-8d4a-b9de2c54878c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:04.800279 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6c4025bf-badc-422a-8d4a-b9de2c54878c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:04.800721 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6c4025bf-badc-422a-8d4a-b9de2c54878c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:04.801479 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6c4025bf-badc-422a-8d4a-b9de2c54878c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:04.801906 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6c4025bf-badc-422a-8d4a-b9de2c54878c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:04.839217 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-17d55836-667e-42c1-8a38-1f68aaafa50a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:04.846424 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-17d55836-667e-42c1-8a38-1f68aaafa50a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.214745 Aug 19 09:18:04.847181 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 71/155] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:04 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:04.991261 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6c4025bf-badc-422a-8d4a-b9de2c54878c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:05.000964 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6c4025bf-badc-422a-8d4a-b9de2c54878c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.210860 Aug 19 09:18:05.001653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 85/156] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:04 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:05.089160 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9ac1ef99-6c8f-4ee8-84cf-8323bc7df0e7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:05.089899 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9ac1ef99-6c8f-4ee8-84cf-8323bc7df0e7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:05.095702 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ac1ef99-6c8f-4ee8-84cf-8323bc7df0e7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:05.096154 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ac1ef99-6c8f-4ee8-84cf-8323bc7df0e7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:05.096920 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ac1ef99-6c8f-4ee8-84cf-8323bc7df0e7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:05.097356 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ac1ef99-6c8f-4ee8-84cf-8323bc7df0e7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:05.284437 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9ac1ef99-6c8f-4ee8-84cf-8323bc7df0e7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:05.294288 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9ac1ef99-6c8f-4ee8-84cf-8323bc7df0e7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:05.296153 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9ac1ef99-6c8f-4ee8-84cf-8323bc7df0e7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:05.297242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9ac1ef99-6c8f-4ee8-84cf-8323bc7df0e7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.211829 Aug 19 09:18:05.297962 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 72/157] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:05 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:05.622939 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-eeda6bd2-1d6d-4d87-a660-49479ad11fb9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:05.623572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-eeda6bd2-1d6d-4d87-a660-49479ad11fb9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:05.629231 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eeda6bd2-1d6d-4d87-a660-49479ad11fb9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:05.629654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eeda6bd2-1d6d-4d87-a660-49479ad11fb9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:05.630409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eeda6bd2-1d6d-4d87-a660-49479ad11fb9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:05.630838 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eeda6bd2-1d6d-4d87-a660-49479ad11fb9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:05.751008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-eeda6bd2-1d6d-4d87-a660-49479ad11fb9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:05.758157 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-eeda6bd2-1d6d-4d87-a660-49479ad11fb9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.138900 Aug 19 09:18:05.758794 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 86/158] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:05 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:05.863000 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e82637fc-3949-4770-bd1d-acbba85c140f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:05.863637 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e82637fc-3949-4770-bd1d-acbba85c140f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:05.869513 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e82637fc-3949-4770-bd1d-acbba85c140f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:05.869972 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e82637fc-3949-4770-bd1d-acbba85c140f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:05.870734 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e82637fc-3949-4770-bd1d-acbba85c140f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:05.871168 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e82637fc-3949-4770-bd1d-acbba85c140f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:05.995663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e82637fc-3949-4770-bd1d-acbba85c140f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:06.003611 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e82637fc-3949-4770-bd1d-acbba85c140f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.144114 Aug 19 09:18:06.004179 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 73/159] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:05 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:06.018076 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e8a1cc21-055a-4d03-9a6d-ac3a8de8549a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:06.019057 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e8a1cc21-055a-4d03-9a6d-ac3a8de8549a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:06.024386 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e8a1cc21-055a-4d03-9a6d-ac3a8de8549a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:06.024821 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e8a1cc21-055a-4d03-9a6d-ac3a8de8549a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:06.025583 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e8a1cc21-055a-4d03-9a6d-ac3a8de8549a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:06.026010 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e8a1cc21-055a-4d03-9a6d-ac3a8de8549a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:06.153300 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e8a1cc21-055a-4d03-9a6d-ac3a8de8549a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:06.160410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e8a1cc21-055a-4d03-9a6d-ac3a8de8549a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.145905 Aug 19 09:18:06.160967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 87/160] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:06 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:06.315126 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2cb485d4-d930-43d6-acf3-30e938d9ad1e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:06.315761 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2cb485d4-d930-43d6-acf3-30e938d9ad1e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:06.321368 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2cb485d4-d930-43d6-acf3-30e938d9ad1e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:06.321816 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2cb485d4-d930-43d6-acf3-30e938d9ad1e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:06.322573 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2cb485d4-d930-43d6-acf3-30e938d9ad1e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:06.323008 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2cb485d4-d930-43d6-acf3-30e938d9ad1e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:06.443370 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2cb485d4-d930-43d6-acf3-30e938d9ad1e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:06.451761 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2cb485d4-d930-43d6-acf3-30e938d9ad1e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:06.453254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2cb485d4-d930-43d6-acf3-30e938d9ad1e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:06.454329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2cb485d4-d930-43d6-acf3-30e938d9ad1e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.142798 Aug 19 09:18:06.454885 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 74/161] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:06 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:06.775769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-998968f4-7c5a-4c26-b97d-926f23f1eb1f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:06.776564 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-998968f4-7c5a-4c26-b97d-926f23f1eb1f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:06.783786 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-998968f4-7c5a-4c26-b97d-926f23f1eb1f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:06.784245 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-998968f4-7c5a-4c26-b97d-926f23f1eb1f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:06.785026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-998968f4-7c5a-4c26-b97d-926f23f1eb1f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:06.785461 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-998968f4-7c5a-4c26-b97d-926f23f1eb1f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:06.991777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-998968f4-7c5a-4c26-b97d-926f23f1eb1f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:06.999582 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-998968f4-7c5a-4c26-b97d-926f23f1eb1f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.227669 Aug 19 09:18:07.000140 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 88/162] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:06 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:07.022826 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-066075dd-3190-4796-b489-587d19a89578 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:07.023555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-066075dd-3190-4796-b489-587d19a89578 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:07.029486 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-066075dd-3190-4796-b489-587d19a89578 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:07.029934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-066075dd-3190-4796-b489-587d19a89578 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:07.030697 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-066075dd-3190-4796-b489-587d19a89578 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:07.031126 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-066075dd-3190-4796-b489-587d19a89578 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:07.165649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-066075dd-3190-4796-b489-587d19a89578 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:07.177555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-066075dd-3190-4796-b489-587d19a89578 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.158211 Aug 19 09:18:07.178145 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 75/163] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:07 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:07.178560 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-569e18a5-2df1-4383-8612-4d9b7d9d344d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:07.179449 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-569e18a5-2df1-4383-8612-4d9b7d9d344d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:07.186663 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-569e18a5-2df1-4383-8612-4d9b7d9d344d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:07.187252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-569e18a5-2df1-4383-8612-4d9b7d9d344d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:07.188190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-569e18a5-2df1-4383-8612-4d9b7d9d344d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:07.188984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-569e18a5-2df1-4383-8612-4d9b7d9d344d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:07.330365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-569e18a5-2df1-4383-8612-4d9b7d9d344d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:07.337571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-569e18a5-2df1-4383-8612-4d9b7d9d344d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.163851 Aug 19 09:18:07.338315 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 89/164] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:07 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:07.472538 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9280b25c-9794-4e26-a738-383bf4b53aa9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:07.473411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9280b25c-9794-4e26-a738-383bf4b53aa9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:07.479996 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9280b25c-9794-4e26-a738-383bf4b53aa9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:07.480440 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9280b25c-9794-4e26-a738-383bf4b53aa9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:07.481975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9280b25c-9794-4e26-a738-383bf4b53aa9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:07.482834 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9280b25c-9794-4e26-a738-383bf4b53aa9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:07.689723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9280b25c-9794-4e26-a738-383bf4b53aa9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:07.698125 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9280b25c-9794-4e26-a738-383bf4b53aa9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:07.699779 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9280b25c-9794-4e26-a738-383bf4b53aa9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:07.701159 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9280b25c-9794-4e26-a738-383bf4b53aa9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.232352 Aug 19 09:18:07.701518 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 76/165] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:07 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:08.019144 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-13bb58b8-3b3a-4954-9b9a-e90d3bdbf60a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:08.020141 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-13bb58b8-3b3a-4954-9b9a-e90d3bdbf60a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:08.025873 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13bb58b8-3b3a-4954-9b9a-e90d3bdbf60a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:08.026326 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13bb58b8-3b3a-4954-9b9a-e90d3bdbf60a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:08.027298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13bb58b8-3b3a-4954-9b9a-e90d3bdbf60a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:08.028497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13bb58b8-3b3a-4954-9b9a-e90d3bdbf60a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:08.164971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-13bb58b8-3b3a-4954-9b9a-e90d3bdbf60a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:08.172132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-13bb58b8-3b3a-4954-9b9a-e90d3bdbf60a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.158123 Aug 19 09:18:08.172688 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 90/166] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:08 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:08.195650 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ac9acc93-4d52-4053-906e-872d00dc000b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:08.196328 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ac9acc93-4d52-4053-906e-872d00dc000b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:08.204176 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ac9acc93-4d52-4053-906e-872d00dc000b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:08.204629 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ac9acc93-4d52-4053-906e-872d00dc000b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:08.205485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ac9acc93-4d52-4053-906e-872d00dc000b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:08.205943 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ac9acc93-4d52-4053-906e-872d00dc000b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:08.352188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ac9acc93-4d52-4053-906e-872d00dc000b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:08.354166 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-98f2867a-0991-4f42-9323-6d0fea6d5221 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:08.354835 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-98f2867a-0991-4f42-9323-6d0fea6d5221 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:08.360805 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ac9acc93-4d52-4053-906e-872d00dc000b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.169215 Aug 19 09:18:08.361402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 77/167] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:08 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:08.362325 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98f2867a-0991-4f42-9323-6d0fea6d5221 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:08.362769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98f2867a-0991-4f42-9323-6d0fea6d5221 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:08.363563 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98f2867a-0991-4f42-9323-6d0fea6d5221 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:08.363995 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98f2867a-0991-4f42-9323-6d0fea6d5221 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:08.482303 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-98f2867a-0991-4f42-9323-6d0fea6d5221 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:08.490156 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-98f2867a-0991-4f42-9323-6d0fea6d5221 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.139680 Aug 19 09:18:08.490705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 91/168] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:08 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:08.717939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bbd08855-6b27-4414-8eb8-46324fdd4a81 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:08.718545 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bbd08855-6b27-4414-8eb8-46324fdd4a81 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:08.724950 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bbd08855-6b27-4414-8eb8-46324fdd4a81 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:08.725389 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bbd08855-6b27-4414-8eb8-46324fdd4a81 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:08.726142 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bbd08855-6b27-4414-8eb8-46324fdd4a81 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:08.726577 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bbd08855-6b27-4414-8eb8-46324fdd4a81 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:08.848360 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bbd08855-6b27-4414-8eb8-46324fdd4a81 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:08.856578 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bbd08855-6b27-4414-8eb8-46324fdd4a81 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:08.858096 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bbd08855-6b27-4414-8eb8-46324fdd4a81 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:08.859373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bbd08855-6b27-4414-8eb8-46324fdd4a81 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.145313 Aug 19 09:18:08.860064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 78/169] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:08 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:09.188836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c7e50f12-93ea-4f56-97b3-a6af98ae6426 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:09.190008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c7e50f12-93ea-4f56-97b3-a6af98ae6426 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:09.196278 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c7e50f12-93ea-4f56-97b3-a6af98ae6426 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:09.196803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c7e50f12-93ea-4f56-97b3-a6af98ae6426 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:09.197806 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c7e50f12-93ea-4f56-97b3-a6af98ae6426 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:09.198220 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c7e50f12-93ea-4f56-97b3-a6af98ae6426 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:09.321638 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c7e50f12-93ea-4f56-97b3-a6af98ae6426 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:09.329883 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c7e50f12-93ea-4f56-97b3-a6af98ae6426 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.144955 Aug 19 09:18:09.339082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 92/170] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:09 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:09.382569 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8d3516e6-66f0-4c78-b485-a39602888485 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:09.383779 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8d3516e6-66f0-4c78-b485-a39602888485 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:09.390825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8d3516e6-66f0-4c78-b485-a39602888485 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:09.391320 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8d3516e6-66f0-4c78-b485-a39602888485 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:09.392095 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8d3516e6-66f0-4c78-b485-a39602888485 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:09.393000 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8d3516e6-66f0-4c78-b485-a39602888485 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:09.507480 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-45d903ec-3b54-47a7-a937-7f103814be7c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:09.508305 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-45d903ec-3b54-47a7-a937-7f103814be7c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:09.515052 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45d903ec-3b54-47a7-a937-7f103814be7c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:09.515517 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45d903ec-3b54-47a7-a937-7f103814be7c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:09.519494 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8d3516e6-66f0-4c78-b485-a39602888485 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:09.522721 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45d903ec-3b54-47a7-a937-7f103814be7c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:09.523454 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45d903ec-3b54-47a7-a937-7f103814be7c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:09.527076 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8d3516e6-66f0-4c78-b485-a39602888485 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.148281 Aug 19 09:18:09.528123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 79/171] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:09 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:09.678894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-45d903ec-3b54-47a7-a937-7f103814be7c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:09.687604 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-45d903ec-3b54-47a7-a937-7f103814be7c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.184144 Aug 19 09:18:09.688176 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 93/172] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:09 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:09.877817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-64cde066-b054-43fa-bc18-bec059cb727b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:09.878424 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-64cde066-b054-43fa-bc18-bec059cb727b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:09.884226 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-64cde066-b054-43fa-bc18-bec059cb727b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:09.884678 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-64cde066-b054-43fa-bc18-bec059cb727b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:09.885450 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-64cde066-b054-43fa-bc18-bec059cb727b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:09.885883 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-64cde066-b054-43fa-bc18-bec059cb727b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:10.010041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-64cde066-b054-43fa-bc18-bec059cb727b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:10.019842 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-64cde066-b054-43fa-bc18-bec059cb727b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:10.021357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-64cde066-b054-43fa-bc18-bec059cb727b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:10.022724 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-64cde066-b054-43fa-bc18-bec059cb727b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.148546 Aug 19 09:18:10.023455 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 80/173] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:09 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:10.347152 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e4b436e4-3f54-4d10-a996-d2f45ed85ae8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:10.348029 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e4b436e4-3f54-4d10-a996-d2f45ed85ae8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:10.359560 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4b436e4-3f54-4d10-a996-d2f45ed85ae8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:10.360006 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4b436e4-3f54-4d10-a996-d2f45ed85ae8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:10.360772 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4b436e4-3f54-4d10-a996-d2f45ed85ae8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:10.361720 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4b436e4-3f54-4d10-a996-d2f45ed85ae8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:10.531043 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e4b436e4-3f54-4d10-a996-d2f45ed85ae8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:10.538528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e4b436e4-3f54-4d10-a996-d2f45ed85ae8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.195023 Aug 19 09:18:10.539157 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 94/174] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:10 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:10.545077 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8295f70f-b195-4af7-b33e-0c53bc27b757 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:10.545880 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8295f70f-b195-4af7-b33e-0c53bc27b757 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:10.551549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8295f70f-b195-4af7-b33e-0c53bc27b757 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:10.551997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8295f70f-b195-4af7-b33e-0c53bc27b757 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:10.552756 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8295f70f-b195-4af7-b33e-0c53bc27b757 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:10.553189 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8295f70f-b195-4af7-b33e-0c53bc27b757 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:10.673377 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8295f70f-b195-4af7-b33e-0c53bc27b757 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:10.680481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8295f70f-b195-4af7-b33e-0c53bc27b757 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.139362 Aug 19 09:18:10.681030 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 81/175] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:10 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:10.704735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1d2ea038-5a7e-4919-bf29-4083eb2f6350 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:10.705306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1d2ea038-5a7e-4919-bf29-4083eb2f6350 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:10.711075 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1d2ea038-5a7e-4919-bf29-4083eb2f6350 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:10.711564 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1d2ea038-5a7e-4919-bf29-4083eb2f6350 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:10.712335 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1d2ea038-5a7e-4919-bf29-4083eb2f6350 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:10.712767 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1d2ea038-5a7e-4919-bf29-4083eb2f6350 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:10.830161 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1d2ea038-5a7e-4919-bf29-4083eb2f6350 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:10.837277 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1d2ea038-5a7e-4919-bf29-4083eb2f6350 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.137148 Aug 19 09:18:10.837835 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 95/176] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:10 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:11.042020 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-06ae9101-557c-4e2a-ba0c-3bd7639ecdb7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:11.042546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-06ae9101-557c-4e2a-ba0c-3bd7639ecdb7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:11.048820 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-06ae9101-557c-4e2a-ba0c-3bd7639ecdb7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:11.049261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-06ae9101-557c-4e2a-ba0c-3bd7639ecdb7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:11.050007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-06ae9101-557c-4e2a-ba0c-3bd7639ecdb7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:11.050433 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-06ae9101-557c-4e2a-ba0c-3bd7639ecdb7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:11.165905 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-06ae9101-557c-4e2a-ba0c-3bd7639ecdb7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:11.173938 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-06ae9101-557c-4e2a-ba0c-3bd7639ecdb7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:11.175446 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-06ae9101-557c-4e2a-ba0c-3bd7639ecdb7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:11.176514 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-06ae9101-557c-4e2a-ba0c-3bd7639ecdb7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.138274 Aug 19 09:18:11.177065 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 82/177] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:11 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:11.555450 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-241606e5-8bac-4f9d-a6ba-f4a5a67eb7d7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:11.556092 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-241606e5-8bac-4f9d-a6ba-f4a5a67eb7d7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:11.563220 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-241606e5-8bac-4f9d-a6ba-f4a5a67eb7d7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:11.563692 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-241606e5-8bac-4f9d-a6ba-f4a5a67eb7d7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:11.564459 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-241606e5-8bac-4f9d-a6ba-f4a5a67eb7d7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:11.564901 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-241606e5-8bac-4f9d-a6ba-f4a5a67eb7d7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:11.690528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-241606e5-8bac-4f9d-a6ba-f4a5a67eb7d7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:11.696547 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7692cb7c-753a-438f-8c85-7ec2d744da9a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:11.697146 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7692cb7c-753a-438f-8c85-7ec2d744da9a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:11.697710 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-241606e5-8bac-4f9d-a6ba-f4a5a67eb7d7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.145821 Aug 19 09:18:11.698263 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 96/178] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:11 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:11.703600 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7692cb7c-753a-438f-8c85-7ec2d744da9a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:11.704044 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7692cb7c-753a-438f-8c85-7ec2d744da9a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:11.704822 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7692cb7c-753a-438f-8c85-7ec2d744da9a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:11.705247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7692cb7c-753a-438f-8c85-7ec2d744da9a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:11.824107 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7692cb7c-753a-438f-8c85-7ec2d744da9a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:11.831928 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7692cb7c-753a-438f-8c85-7ec2d744da9a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.138922 Aug 19 09:18:11.832480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 83/179] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:11 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:11.853575 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-98447713-31a9-4e20-881a-dafd9bd00ec5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:11.854176 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-98447713-31a9-4e20-881a-dafd9bd00ec5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:11.859832 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98447713-31a9-4e20-881a-dafd9bd00ec5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:11.860271 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98447713-31a9-4e20-881a-dafd9bd00ec5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:11.861017 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98447713-31a9-4e20-881a-dafd9bd00ec5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:11.861442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98447713-31a9-4e20-881a-dafd9bd00ec5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:11.982423 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-98447713-31a9-4e20-881a-dafd9bd00ec5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:11.989525 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-98447713-31a9-4e20-881a-dafd9bd00ec5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.139552 Aug 19 09:18:11.990068 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 97/180] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:11 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:12.194758 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c7e77406-24d4-4aec-908a-5332114e7ade tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:12.195340 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c7e77406-24d4-4aec-908a-5332114e7ade tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:12.201767 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c7e77406-24d4-4aec-908a-5332114e7ade tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:12.202227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c7e77406-24d4-4aec-908a-5332114e7ade tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:12.202969 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c7e77406-24d4-4aec-908a-5332114e7ade tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:12.203440 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c7e77406-24d4-4aec-908a-5332114e7ade tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:12.318629 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c7e77406-24d4-4aec-908a-5332114e7ade tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:12.326773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c7e77406-24d4-4aec-908a-5332114e7ade tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:12.328286 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c7e77406-24d4-4aec-908a-5332114e7ade tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:12.329350 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c7e77406-24d4-4aec-908a-5332114e7ade tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.138362 Aug 19 09:18:12.329898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 84/181] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:12 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:12.715185 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1fd07c34-e44a-4177-9fb2-b77077d649e1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:12.716678 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1fd07c34-e44a-4177-9fb2-b77077d649e1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:12.722510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fd07c34-e44a-4177-9fb2-b77077d649e1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:12.723158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fd07c34-e44a-4177-9fb2-b77077d649e1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:12.723957 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fd07c34-e44a-4177-9fb2-b77077d649e1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:12.724403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fd07c34-e44a-4177-9fb2-b77077d649e1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:12.842386 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1fd07c34-e44a-4177-9fb2-b77077d649e1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:12.848828 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a7b70aa5-8b89-4acd-a5fe-bdf4a3e011a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:12.849434 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a7b70aa5-8b89-4acd-a5fe-bdf4a3e011a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:12.849844 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1fd07c34-e44a-4177-9fb2-b77077d649e1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.138230 Aug 19 09:18:12.850407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 98/182] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:12 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:12.855245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a7b70aa5-8b89-4acd-a5fe-bdf4a3e011a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:12.855784 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a7b70aa5-8b89-4acd-a5fe-bdf4a3e011a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:12.857226 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a7b70aa5-8b89-4acd-a5fe-bdf4a3e011a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:12.857657 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a7b70aa5-8b89-4acd-a5fe-bdf4a3e011a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:12.975982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a7b70aa5-8b89-4acd-a5fe-bdf4a3e011a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:12.983748 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a7b70aa5-8b89-4acd-a5fe-bdf4a3e011a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.138684 Aug 19 09:18:12.984310 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 85/183] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:12 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:13.005513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4aab222c-7754-4380-b113-fcd07051d4f4 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:13.006286 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4aab222c-7754-4380-b113-fcd07051d4f4 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:13.013049 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4aab222c-7754-4380-b113-fcd07051d4f4 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:13.013503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4aab222c-7754-4380-b113-fcd07051d4f4 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:13.014284 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4aab222c-7754-4380-b113-fcd07051d4f4 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:13.014712 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4aab222c-7754-4380-b113-fcd07051d4f4 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:13.135162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4aab222c-7754-4380-b113-fcd07051d4f4 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:13.142867 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4aab222c-7754-4380-b113-fcd07051d4f4 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.140982 Aug 19 09:18:13.143449 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 99/184] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:13 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:13.347734 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d5a76b38-2813-4c52-9f94-bbf627c38f01 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:13.348520 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d5a76b38-2813-4c52-9f94-bbf627c38f01 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:13.354306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5a76b38-2813-4c52-9f94-bbf627c38f01 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:13.354749 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5a76b38-2813-4c52-9f94-bbf627c38f01 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:13.355524 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5a76b38-2813-4c52-9f94-bbf627c38f01 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:13.355967 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5a76b38-2813-4c52-9f94-bbf627c38f01 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:13.474805 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d5a76b38-2813-4c52-9f94-bbf627c38f01 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:13.482914 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d5a76b38-2813-4c52-9f94-bbf627c38f01 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:13.484486 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d5a76b38-2813-4c52-9f94-bbf627c38f01 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:13.485558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d5a76b38-2813-4c52-9f94-bbf627c38f01 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.141705 Aug 19 09:18:13.486103 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 86/185] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:13 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:13.866815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-73e01f4e-4231-4aa9-a179-a2c71e531de2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:13.867487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-73e01f4e-4231-4aa9-a179-a2c71e531de2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:13.874003 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-73e01f4e-4231-4aa9-a179-a2c71e531de2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:13.874447 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-73e01f4e-4231-4aa9-a179-a2c71e531de2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:13.875205 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-73e01f4e-4231-4aa9-a179-a2c71e531de2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:13.875732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-73e01f4e-4231-4aa9-a179-a2c71e531de2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:13.990958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-73e01f4e-4231-4aa9-a179-a2c71e531de2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:13.998715 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-73e01f4e-4231-4aa9-a179-a2c71e531de2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.135561 Aug 19 09:18:13.999291 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 100/186] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:13 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:14.000466 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-80cab7a8-7350-4828-a42e-83750c10e161 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:14.001080 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-80cab7a8-7350-4828-a42e-83750c10e161 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:14.007097 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-80cab7a8-7350-4828-a42e-83750c10e161 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:14.007598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-80cab7a8-7350-4828-a42e-83750c10e161 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:14.008318 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-80cab7a8-7350-4828-a42e-83750c10e161 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:14.008777 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-80cab7a8-7350-4828-a42e-83750c10e161 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:14.126711 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-80cab7a8-7350-4828-a42e-83750c10e161 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:14.133866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-80cab7a8-7350-4828-a42e-83750c10e161 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.137636 Aug 19 09:18:14.134424 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 87/187] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:13 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:14.159071 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-14dc57b0-cf4f-40c6-8db9-0a58e522ec0c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:14.159742 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-14dc57b0-cf4f-40c6-8db9-0a58e522ec0c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:14.165375 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-14dc57b0-cf4f-40c6-8db9-0a58e522ec0c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:14.165812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-14dc57b0-cf4f-40c6-8db9-0a58e522ec0c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:14.166558 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-14dc57b0-cf4f-40c6-8db9-0a58e522ec0c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:14.166982 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-14dc57b0-cf4f-40c6-8db9-0a58e522ec0c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:14.283996 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-14dc57b0-cf4f-40c6-8db9-0a58e522ec0c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:14.291063 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-14dc57b0-cf4f-40c6-8db9-0a58e522ec0c tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.135542 Aug 19 09:18:14.291644 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 101/188] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:14 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:14.502910 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-30b6bb00-2a8c-4e32-a8de-1f248d19fbbd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:14.503542 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-30b6bb00-2a8c-4e32-a8de-1f248d19fbbd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:14.509289 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30b6bb00-2a8c-4e32-a8de-1f248d19fbbd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:14.509737 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30b6bb00-2a8c-4e32-a8de-1f248d19fbbd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:14.510489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30b6bb00-2a8c-4e32-a8de-1f248d19fbbd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:14.510918 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30b6bb00-2a8c-4e32-a8de-1f248d19fbbd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:14.629453 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-30b6bb00-2a8c-4e32-a8de-1f248d19fbbd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:14.637843 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-30b6bb00-2a8c-4e32-a8de-1f248d19fbbd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:14.639499 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-30b6bb00-2a8c-4e32-a8de-1f248d19fbbd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:14.640615 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-30b6bb00-2a8c-4e32-a8de-1f248d19fbbd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.141347 Aug 19 09:18:14.641162 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 88/189] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:14 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:15.015968 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-356e3374-746d-44b9-a795-58f1cac94f8a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:15.016569 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-356e3374-746d-44b9-a795-58f1cac94f8a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:15.022332 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-356e3374-746d-44b9-a795-58f1cac94f8a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:15.022770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-356e3374-746d-44b9-a795-58f1cac94f8a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:15.023572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-356e3374-746d-44b9-a795-58f1cac94f8a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:15.023997 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-356e3374-746d-44b9-a795-58f1cac94f8a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:15.143074 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-356e3374-746d-44b9-a795-58f1cac94f8a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:15.150483 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f2a85238-f001-407a-b1b0-ababf721b890 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:15.151016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-356e3374-746d-44b9-a795-58f1cac94f8a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.138999 Aug 19 09:18:15.151127 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f2a85238-f001-407a-b1b0-ababf721b890 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:15.151447 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 102/190] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:15 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:15.157132 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2a85238-f001-407a-b1b0-ababf721b890 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:15.157581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2a85238-f001-407a-b1b0-ababf721b890 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:15.158383 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2a85238-f001-407a-b1b0-ababf721b890 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:15.158816 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2a85238-f001-407a-b1b0-ababf721b890 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:15.308849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3d0fd668-61eb-44a3-a532-a9b901675aff tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:15.309873 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3d0fd668-61eb-44a3-a532-a9b901675aff tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:15.316612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d0fd668-61eb-44a3-a532-a9b901675aff tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:15.317062 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d0fd668-61eb-44a3-a532-a9b901675aff tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:15.317940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d0fd668-61eb-44a3-a532-a9b901675aff tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:15.318440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d0fd668-61eb-44a3-a532-a9b901675aff tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:15.454780 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3d0fd668-61eb-44a3-a532-a9b901675aff tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:15.461871 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3d0fd668-61eb-44a3-a532-a9b901675aff tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.156837 Aug 19 09:18:15.462625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 103/191] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:15 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:15.488872 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f2a85238-f001-407a-b1b0-ababf721b890 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:15.496281 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f2a85238-f001-407a-b1b0-ababf721b890 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.350247 Aug 19 09:18:15.497065 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 89/192] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:15 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:15.658390 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a85d44c2-53c7-45ed-83c4-060a5524680c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:15.659348 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a85d44c2-53c7-45ed-83c4-060a5524680c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:15.665523 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a85d44c2-53c7-45ed-83c4-060a5524680c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:15.666057 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a85d44c2-53c7-45ed-83c4-060a5524680c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:15.666944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a85d44c2-53c7-45ed-83c4-060a5524680c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:15.667490 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a85d44c2-53c7-45ed-83c4-060a5524680c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:15.801523 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a85d44c2-53c7-45ed-83c4-060a5524680c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:15.809851 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a85d44c2-53c7-45ed-83c4-060a5524680c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:15.811526 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a85d44c2-53c7-45ed-83c4-060a5524680c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:15.812612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a85d44c2-53c7-45ed-83c4-060a5524680c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.158012 Aug 19 09:18:15.813179 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 104/193] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:15 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:18:16.167572 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-16003fa0-057d-4f82-ae49-c22e03cb2f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:16.168164 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-16003fa0-057d-4f82-ae49-c22e03cb2f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:16.174278 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16003fa0-057d-4f82-ae49-c22e03cb2f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:16.174716 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16003fa0-057d-4f82-ae49-c22e03cb2f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:16.175501 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16003fa0-057d-4f82-ae49-c22e03cb2f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:16.175932 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16003fa0-057d-4f82-ae49-c22e03cb2f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:16.309959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-16003fa0-057d-4f82-ae49-c22e03cb2f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:16.317059 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-16003fa0-057d-4f82-ae49-c22e03cb2f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.153539 Aug 19 09:18:16.317618 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 90/194] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:16 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:16.479488 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f39387a0-5c18-43e1-8732-ad32ef97a9e5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:16.480096 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f39387a0-5c18-43e1-8732-ad32ef97a9e5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:16.486685 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f39387a0-5c18-43e1-8732-ad32ef97a9e5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:16.487127 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f39387a0-5c18-43e1-8732-ad32ef97a9e5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:16.487913 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f39387a0-5c18-43e1-8732-ad32ef97a9e5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:16.488350 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f39387a0-5c18-43e1-8732-ad32ef97a9e5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:16.517548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9af0f946-2c95-4dce-b8d8-10c51711d55d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:16.518152 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9af0f946-2c95-4dce-b8d8-10c51711d55d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:16.524069 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9af0f946-2c95-4dce-b8d8-10c51711d55d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:16.524524 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9af0f946-2c95-4dce-b8d8-10c51711d55d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:16.525282 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9af0f946-2c95-4dce-b8d8-10c51711d55d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:16.525716 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9af0f946-2c95-4dce-b8d8-10c51711d55d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:16.618256 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f39387a0-5c18-43e1-8732-ad32ef97a9e5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:16.626574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f39387a0-5c18-43e1-8732-ad32ef97a9e5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.150903 Aug 19 09:18:16.627290 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 105/195] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:16 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:16.660874 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9af0f946-2c95-4dce-b8d8-10c51711d55d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:16.668359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9af0f946-2c95-4dce-b8d8-10c51711d55d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.154396 Aug 19 09:18:16.669167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 91/196] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:16 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:16.831022 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3da853c4-a761-4db9-bfe7-3d7e68d694d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:16.831656 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3da853c4-a761-4db9-bfe7-3d7e68d694d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:16.837517 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3da853c4-a761-4db9-bfe7-3d7e68d694d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:16.837963 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3da853c4-a761-4db9-bfe7-3d7e68d694d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:16.838713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3da853c4-a761-4db9-bfe7-3d7e68d694d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:16.839145 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3da853c4-a761-4db9-bfe7-3d7e68d694d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:17.140317 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3da853c4-a761-4db9-bfe7-3d7e68d694d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:17.147800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3da853c4-a761-4db9-bfe7-3d7e68d694d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:17.149288 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3da853c4-a761-4db9-bfe7-3d7e68d694d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:17.150349 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3da853c4-a761-4db9-bfe7-3d7e68d694d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.322980 Aug 19 09:18:17.150889 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 106/197] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:16 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:17.333742 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0b247e65-812a-4dfd-b945-b258eccd170b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:17.334356 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0b247e65-812a-4dfd-b945-b258eccd170b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:17.340881 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b247e65-812a-4dfd-b945-b258eccd170b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:17.341878 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b247e65-812a-4dfd-b945-b258eccd170b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:17.342647 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b247e65-812a-4dfd-b945-b258eccd170b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:17.343088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b247e65-812a-4dfd-b945-b258eccd170b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:17.466925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0b247e65-812a-4dfd-b945-b258eccd170b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:17.474202 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0b247e65-812a-4dfd-b945-b258eccd170b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.144138 Aug 19 09:18:17.474758 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 92/198] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:17 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:17.644182 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6de67fa3-bbcb-4c36-8a46-1c95d729cf6a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:17.644703 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6de67fa3-bbcb-4c36-8a46-1c95d729cf6a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:17.650471 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6de67fa3-bbcb-4c36-8a46-1c95d729cf6a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:17.650918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6de67fa3-bbcb-4c36-8a46-1c95d729cf6a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:17.651780 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6de67fa3-bbcb-4c36-8a46-1c95d729cf6a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:17.652217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6de67fa3-bbcb-4c36-8a46-1c95d729cf6a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:17.686559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8f999b8e-e3a1-42fc-b545-0cc05fffbc58 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:17.687167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8f999b8e-e3a1-42fc-b545-0cc05fffbc58 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:17.693005 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8f999b8e-e3a1-42fc-b545-0cc05fffbc58 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:17.693453 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8f999b8e-e3a1-42fc-b545-0cc05fffbc58 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:17.694336 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8f999b8e-e3a1-42fc-b545-0cc05fffbc58 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:17.694779 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8f999b8e-e3a1-42fc-b545-0cc05fffbc58 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:17.775744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6de67fa3-bbcb-4c36-8a46-1c95d729cf6a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:17.784827 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6de67fa3-bbcb-4c36-8a46-1c95d729cf6a tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.144320 Aug 19 09:18:17.785692 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 107/199] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:17 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:17.830263 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8f999b8e-e3a1-42fc-b545-0cc05fffbc58 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:17.837797 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8f999b8e-e3a1-42fc-b545-0cc05fffbc58 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.154833 Aug 19 09:18:17.838328 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 93/200] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:17 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:18.168228 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-824fd510-e865-446f-aa84-dc837c49494f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:18.169293 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-824fd510-e865-446f-aa84-dc837c49494f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:18.176499 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-824fd510-e865-446f-aa84-dc837c49494f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:18.176944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-824fd510-e865-446f-aa84-dc837c49494f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:18.177718 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-824fd510-e865-446f-aa84-dc837c49494f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:18.178149 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-824fd510-e865-446f-aa84-dc837c49494f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:18.301028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-824fd510-e865-446f-aa84-dc837c49494f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:18.308688 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-824fd510-e865-446f-aa84-dc837c49494f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:18.310816 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-824fd510-e865-446f-aa84-dc837c49494f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:18.311917 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-824fd510-e865-446f-aa84-dc837c49494f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.147537 Aug 19 09:18:18.312470 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 108/201] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:18 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:18:18.492329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-edb966fb-f871-4d0f-a70e-894a388a24e4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:18.492931 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-edb966fb-f871-4d0f-a70e-894a388a24e4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:18.499438 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-edb966fb-f871-4d0f-a70e-894a388a24e4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:18.499885 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-edb966fb-f871-4d0f-a70e-894a388a24e4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:18.500643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-edb966fb-f871-4d0f-a70e-894a388a24e4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:18.501079 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-edb966fb-f871-4d0f-a70e-894a388a24e4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:18.618230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-edb966fb-f871-4d0f-a70e-894a388a24e4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:18.625894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-edb966fb-f871-4d0f-a70e-894a388a24e4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.137175 Aug 19 09:18:18.626454 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 94/202] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:18 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:18.801395 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ed5bd8a0-3b73-43a9-8ba2-eb868bb91f0f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:18.801999 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ed5bd8a0-3b73-43a9-8ba2-eb868bb91f0f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:18.807799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ed5bd8a0-3b73-43a9-8ba2-eb868bb91f0f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:18.808243 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ed5bd8a0-3b73-43a9-8ba2-eb868bb91f0f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:18.809314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ed5bd8a0-3b73-43a9-8ba2-eb868bb91f0f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:18.810045 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ed5bd8a0-3b73-43a9-8ba2-eb868bb91f0f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:18.854476 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-38ea8a2b-32d4-408e-b37f-af0e81b8ab68 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:18.855098 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-38ea8a2b-32d4-408e-b37f-af0e81b8ab68 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:18.862689 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38ea8a2b-32d4-408e-b37f-af0e81b8ab68 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:18.863144 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38ea8a2b-32d4-408e-b37f-af0e81b8ab68 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:18.863936 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38ea8a2b-32d4-408e-b37f-af0e81b8ab68 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:18.864368 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38ea8a2b-32d4-408e-b37f-af0e81b8ab68 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:18.946615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ed5bd8a0-3b73-43a9-8ba2-eb868bb91f0f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:18.954233 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ed5bd8a0-3b73-43a9-8ba2-eb868bb91f0f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.156374 Aug 19 09:18:18.954787 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 109/203] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:18 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:18.991968 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-38ea8a2b-32d4-408e-b37f-af0e81b8ab68 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:18.999071 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-38ea8a2b-32d4-408e-b37f-af0e81b8ab68 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.148143 Aug 19 09:18:18.999647 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 95/204] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:18 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:19.330089 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-01c0d316-71d2-4beb-a9ae-181f30c0a19c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:19.330683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-01c0d316-71d2-4beb-a9ae-181f30c0a19c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:19.336570 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01c0d316-71d2-4beb-a9ae-181f30c0a19c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:19.337012 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01c0d316-71d2-4beb-a9ae-181f30c0a19c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:19.337759 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01c0d316-71d2-4beb-a9ae-181f30c0a19c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:19.338186 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01c0d316-71d2-4beb-a9ae-181f30c0a19c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:19.458783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-01c0d316-71d2-4beb-a9ae-181f30c0a19c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:19.467291 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-01c0d316-71d2-4beb-a9ae-181f30c0a19c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:19.468812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-01c0d316-71d2-4beb-a9ae-181f30c0a19c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:19.469894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-01c0d316-71d2-4beb-a9ae-181f30c0a19c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.143512 Aug 19 09:18:19.470442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 110/205] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:19 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:18:19.642476 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8abffd59-96ff-4cdf-b61d-956c8fc67b82 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:19.643092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8abffd59-96ff-4cdf-b61d-956c8fc67b82 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:19.648940 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8abffd59-96ff-4cdf-b61d-956c8fc67b82 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:19.649393 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8abffd59-96ff-4cdf-b61d-956c8fc67b82 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:19.650148 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8abffd59-96ff-4cdf-b61d-956c8fc67b82 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:19.650581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8abffd59-96ff-4cdf-b61d-956c8fc67b82 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:19.769749 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8abffd59-96ff-4cdf-b61d-956c8fc67b82 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:19.776827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8abffd59-96ff-4cdf-b61d-956c8fc67b82 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.137932 Aug 19 09:18:19.777384 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 96/206] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:19 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:19.969466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6c04c61e-2ff8-408d-b6b1-5390f181f1e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:19.970252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6c04c61e-2ff8-408d-b6b1-5390f181f1e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:19.977302 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6c04c61e-2ff8-408d-b6b1-5390f181f1e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:19.977743 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6c04c61e-2ff8-408d-b6b1-5390f181f1e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:19.978550 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6c04c61e-2ff8-408d-b6b1-5390f181f1e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:19.978928 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6c04c61e-2ff8-408d-b6b1-5390f181f1e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:20.015681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8d8552c3-91b8-43e5-9f70-6467fdeab5eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:20.016284 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8d8552c3-91b8-43e5-9f70-6467fdeab5eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:20.022329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8d8552c3-91b8-43e5-9f70-6467fdeab5eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:20.022895 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8d8552c3-91b8-43e5-9f70-6467fdeab5eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:20.023560 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8d8552c3-91b8-43e5-9f70-6467fdeab5eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:20.026480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8d8552c3-91b8-43e5-9f70-6467fdeab5eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:20.109551 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6c04c61e-2ff8-408d-b6b1-5390f181f1e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:20.116935 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6c04c61e-2ff8-408d-b6b1-5390f181f1e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.150979 Aug 19 09:18:20.117512 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 111/207] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:19 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:20.149794 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8d8552c3-91b8-43e5-9f70-6467fdeab5eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:20.157604 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8d8552c3-91b8-43e5-9f70-6467fdeab5eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.146285 Aug 19 09:18:20.158161 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 97/208] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:20 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:20.487195 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ccb7c132-991b-4d07-9312-75d90dc47c74 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:20.487855 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ccb7c132-991b-4d07-9312-75d90dc47c74 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:20.493614 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ccb7c132-991b-4d07-9312-75d90dc47c74 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:20.494055 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ccb7c132-991b-4d07-9312-75d90dc47c74 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:20.494800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ccb7c132-991b-4d07-9312-75d90dc47c74 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:20.495224 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ccb7c132-991b-4d07-9312-75d90dc47c74 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:20.618174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ccb7c132-991b-4d07-9312-75d90dc47c74 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:20.625952 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ccb7c132-991b-4d07-9312-75d90dc47c74 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:20.627528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ccb7c132-991b-4d07-9312-75d90dc47c74 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:20.628591 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ccb7c132-991b-4d07-9312-75d90dc47c74 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.145039 Aug 19 09:18:20.629129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 112/209] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:20 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:20.793420 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-639b6e08-dea9-4268-b130-800969e625b1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:20.793959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-639b6e08-dea9-4268-b130-800969e625b1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:20.799797 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-639b6e08-dea9-4268-b130-800969e625b1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:20.800237 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-639b6e08-dea9-4268-b130-800969e625b1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:20.800981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-639b6e08-dea9-4268-b130-800969e625b1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:20.801405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-639b6e08-dea9-4268-b130-800969e625b1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:20.926745 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-639b6e08-dea9-4268-b130-800969e625b1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:20.933815 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-639b6e08-dea9-4268-b130-800969e625b1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.144229 Aug 19 09:18:20.934675 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 98/210] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:20 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:21.133640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-dd6f45cc-0438-4449-9118-8e3491ce16be tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:21.134249 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-dd6f45cc-0438-4449-9118-8e3491ce16be tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:21.140604 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dd6f45cc-0438-4449-9118-8e3491ce16be tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:21.141048 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dd6f45cc-0438-4449-9118-8e3491ce16be tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:21.141805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dd6f45cc-0438-4449-9118-8e3491ce16be tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:21.142232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dd6f45cc-0438-4449-9118-8e3491ce16be tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:21.174153 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e2b7fd01-f3b0-4369-9a58-1db6e351ae0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:21.174763 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e2b7fd01-f3b0-4369-9a58-1db6e351ae0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:21.180568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e2b7fd01-f3b0-4369-9a58-1db6e351ae0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:21.181019 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e2b7fd01-f3b0-4369-9a58-1db6e351ae0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:21.181786 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e2b7fd01-f3b0-4369-9a58-1db6e351ae0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:21.182228 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e2b7fd01-f3b0-4369-9a58-1db6e351ae0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:21.260436 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dd6f45cc-0438-4449-9118-8e3491ce16be tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:21.272363 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-dd6f45cc-0438-4449-9118-8e3491ce16be tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.142290 Aug 19 09:18:21.272940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 113/211] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:21 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:21.307523 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e2b7fd01-f3b0-4369-9a58-1db6e351ae0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:21.315506 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e2b7fd01-f3b0-4369-9a58-1db6e351ae0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.145506 Aug 19 09:18:21.316062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 99/212] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:21 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:21.646914 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3dae5981-635a-464f-a24e-07d88dfc23ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:21.647532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3dae5981-635a-464f-a24e-07d88dfc23ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:21.653428 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3dae5981-635a-464f-a24e-07d88dfc23ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:21.653874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3dae5981-635a-464f-a24e-07d88dfc23ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:21.654619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3dae5981-635a-464f-a24e-07d88dfc23ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:21.655043 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3dae5981-635a-464f-a24e-07d88dfc23ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:21.775310 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3dae5981-635a-464f-a24e-07d88dfc23ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:21.783668 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3dae5981-635a-464f-a24e-07d88dfc23ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:21.785166 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3dae5981-635a-464f-a24e-07d88dfc23ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:21.786238 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3dae5981-635a-464f-a24e-07d88dfc23ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.143076 Aug 19 09:18:21.786796 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 114/213] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:21 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:18:21.951141 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c092413b-0109-4869-ab00-9691c19a8ac6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:21.951827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c092413b-0109-4869-ab00-9691c19a8ac6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:21.957518 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c092413b-0109-4869-ab00-9691c19a8ac6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:21.957964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c092413b-0109-4869-ab00-9691c19a8ac6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:21.958718 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c092413b-0109-4869-ab00-9691c19a8ac6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:21.959179 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c092413b-0109-4869-ab00-9691c19a8ac6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:22.081804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c092413b-0109-4869-ab00-9691c19a8ac6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:22.088859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c092413b-0109-4869-ab00-9691c19a8ac6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.141368 Aug 19 09:18:22.089413 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 100/214] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:21 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:22.289429 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-df16d4e8-40d8-4133-aed7-e08e0a2828d5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:22.289936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-df16d4e8-40d8-4133-aed7-e08e0a2828d5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:22.295958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-df16d4e8-40d8-4133-aed7-e08e0a2828d5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:22.296401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-df16d4e8-40d8-4133-aed7-e08e0a2828d5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:22.297152 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-df16d4e8-40d8-4133-aed7-e08e0a2828d5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:22.297588 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-df16d4e8-40d8-4133-aed7-e08e0a2828d5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:22.333388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f7513c0f-6075-4a28-bf19-cdf5cf5fe500 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:22.334020 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f7513c0f-6075-4a28-bf19-cdf5cf5fe500 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:22.340478 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f7513c0f-6075-4a28-bf19-cdf5cf5fe500 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:22.340931 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f7513c0f-6075-4a28-bf19-cdf5cf5fe500 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:22.342312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f7513c0f-6075-4a28-bf19-cdf5cf5fe500 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:22.342960 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f7513c0f-6075-4a28-bf19-cdf5cf5fe500 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:22.423191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-df16d4e8-40d8-4133-aed7-e08e0a2828d5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:22.431074 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-df16d4e8-40d8-4133-aed7-e08e0a2828d5 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.145278 Aug 19 09:18:22.431661 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 115/215] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:22 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:22.468466 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f7513c0f-6075-4a28-bf19-cdf5cf5fe500 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:22.475827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f7513c0f-6075-4a28-bf19-cdf5cf5fe500 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.146603 Aug 19 09:18:22.476372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 101/216] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:22 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:22.804530 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-739c29df-454f-40de-884c-619f0e6b0857 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:22.805129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-739c29df-454f-40de-884c-619f0e6b0857 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:22.811750 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-739c29df-454f-40de-884c-619f0e6b0857 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:22.812192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-739c29df-454f-40de-884c-619f0e6b0857 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:22.812945 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-739c29df-454f-40de-884c-619f0e6b0857 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:22.813370 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-739c29df-454f-40de-884c-619f0e6b0857 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:22.936162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-739c29df-454f-40de-884c-619f0e6b0857 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:22.944927 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-739c29df-454f-40de-884c-619f0e6b0857 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:22.946438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-739c29df-454f-40de-884c-619f0e6b0857 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:22.947553 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-739c29df-454f-40de-884c-619f0e6b0857 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.146736 Aug 19 09:18:22.948106 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 116/217] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:22 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:23.106169 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-88274c31-3697-4e77-a32e-f297c46c0d63 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:23.106785 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-88274c31-3697-4e77-a32e-f297c46c0d63 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:23.113797 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88274c31-3697-4e77-a32e-f297c46c0d63 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:23.114249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88274c31-3697-4e77-a32e-f297c46c0d63 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:23.115011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88274c31-3697-4e77-a32e-f297c46c0d63 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:23.115480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88274c31-3697-4e77-a32e-f297c46c0d63 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:23.244637 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-88274c31-3697-4e77-a32e-f297c46c0d63 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:23.252135 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-88274c31-3697-4e77-a32e-f297c46c0d63 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.150096 Aug 19 09:18:23.252690 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 102/218] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:23 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:23.446990 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3e0e1287-cac5-4255-9684-e87fae570f0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:23.447895 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3e0e1287-cac5-4255-9684-e87fae570f0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:23.453735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3e0e1287-cac5-4255-9684-e87fae570f0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:23.454178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3e0e1287-cac5-4255-9684-e87fae570f0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:23.454945 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3e0e1287-cac5-4255-9684-e87fae570f0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:23.455403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3e0e1287-cac5-4255-9684-e87fae570f0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:23.492417 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6d782dc4-0a99-49e3-8959-af433b50248d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:23.493110 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6d782dc4-0a99-49e3-8959-af433b50248d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:23.499566 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6d782dc4-0a99-49e3-8959-af433b50248d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:23.502777 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6d782dc4-0a99-49e3-8959-af433b50248d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:23.503910 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6d782dc4-0a99-49e3-8959-af433b50248d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:23.504414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6d782dc4-0a99-49e3-8959-af433b50248d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:23.604512 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3e0e1287-cac5-4255-9684-e87fae570f0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:23.612518 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3e0e1287-cac5-4255-9684-e87fae570f0b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.169140 Aug 19 09:18:23.613127 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 117/219] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:23 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:23.645219 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6d782dc4-0a99-49e3-8959-af433b50248d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:23.652372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6d782dc4-0a99-49e3-8959-af433b50248d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.163804 Aug 19 09:18:23.653093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 103/220] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:23 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:23.972727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3b0851f6-9772-456a-ad54-6c839bbf8f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:23.983708 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3b0851f6-9772-456a-ad54-6c839bbf8f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:23.994610 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b0851f6-9772-456a-ad54-6c839bbf8f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:23.995129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b0851f6-9772-456a-ad54-6c839bbf8f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:23.995936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b0851f6-9772-456a-ad54-6c839bbf8f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:23.996371 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b0851f6-9772-456a-ad54-6c839bbf8f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:24.185856 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3b0851f6-9772-456a-ad54-6c839bbf8f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:24.194480 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3b0851f6-9772-456a-ad54-6c839bbf8f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:24.196033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3b0851f6-9772-456a-ad54-6c839bbf8f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:24.197899 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3b0851f6-9772-456a-ad54-6c839bbf8f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.233993 Aug 19 09:18:24.214868 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 118/221] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:23 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:24.276791 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6f8172f2-a7c7-4e8e-a64e-9809673411c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:24.278058 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6f8172f2-a7c7-4e8e-a64e-9809673411c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:24.290405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f8172f2-a7c7-4e8e-a64e-9809673411c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:24.290405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f8172f2-a7c7-4e8e-a64e-9809673411c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:24.290405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f8172f2-a7c7-4e8e-a64e-9809673411c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:24.290405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f8172f2-a7c7-4e8e-a64e-9809673411c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:24.420367 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6f8172f2-a7c7-4e8e-a64e-9809673411c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:24.427595 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6f8172f2-a7c7-4e8e-a64e-9809673411c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.162786 Aug 19 09:18:24.431316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 104/222] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:24 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:24.629622 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f55ae35b-6f52-4b6f-a3d2-02dcedf60758 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:24.630223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f55ae35b-6f52-4b6f-a3d2-02dcedf60758 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:24.636013 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f55ae35b-6f52-4b6f-a3d2-02dcedf60758 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:24.636448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f55ae35b-6f52-4b6f-a3d2-02dcedf60758 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:24.637194 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f55ae35b-6f52-4b6f-a3d2-02dcedf60758 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:24.637618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f55ae35b-6f52-4b6f-a3d2-02dcedf60758 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:24.670348 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e9d79ada-961a-4170-aee6-6d1cb01c2e1c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:24.670876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e9d79ada-961a-4170-aee6-6d1cb01c2e1c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:24.676779 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e9d79ada-961a-4170-aee6-6d1cb01c2e1c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:24.677489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e9d79ada-961a-4170-aee6-6d1cb01c2e1c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:24.678594 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e9d79ada-961a-4170-aee6-6d1cb01c2e1c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:24.679193 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e9d79ada-961a-4170-aee6-6d1cb01c2e1c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:24.765022 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f55ae35b-6f52-4b6f-a3d2-02dcedf60758 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:24.772373 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f55ae35b-6f52-4b6f-a3d2-02dcedf60758 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.146437 Aug 19 09:18:24.772940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 119/223] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:24 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:24.803054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e9d79ada-961a-4170-aee6-6d1cb01c2e1c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:24.810208 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e9d79ada-961a-4170-aee6-6d1cb01c2e1c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.144279 Aug 19 09:18:24.810975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 105/224] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:24 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:25.222438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f3d27b7d-1f9f-4d90-9fb9-f3ac5607b4c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:25.223306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f3d27b7d-1f9f-4d90-9fb9-f3ac5607b4c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:25.229065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3d27b7d-1f9f-4d90-9fb9-f3ac5607b4c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:25.229504 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3d27b7d-1f9f-4d90-9fb9-f3ac5607b4c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:25.230251 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3d27b7d-1f9f-4d90-9fb9-f3ac5607b4c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:25.230677 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3d27b7d-1f9f-4d90-9fb9-f3ac5607b4c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:25.367777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f3d27b7d-1f9f-4d90-9fb9-f3ac5607b4c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:25.375817 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f3d27b7d-1f9f-4d90-9fb9-f3ac5607b4c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:25.377314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f3d27b7d-1f9f-4d90-9fb9-f3ac5607b4c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:25.378381 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f3d27b7d-1f9f-4d90-9fb9-f3ac5607b4c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.159596 Aug 19 09:18:25.378922 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 120/225] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:25 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:25.447362 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cce9a990-e95a-4403-bfc3-722477b90633 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:25.447974 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-cce9a990-e95a-4403-bfc3-722477b90633 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:25.454407 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cce9a990-e95a-4403-bfc3-722477b90633 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:25.454789 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cce9a990-e95a-4403-bfc3-722477b90633 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:25.455572 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cce9a990-e95a-4403-bfc3-722477b90633 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:25.456007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cce9a990-e95a-4403-bfc3-722477b90633 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:25.579109 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-cce9a990-e95a-4403-bfc3-722477b90633 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:25.586447 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-cce9a990-e95a-4403-bfc3-722477b90633 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.142732 Aug 19 09:18:25.587005 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 106/226] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:25 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:25.790855 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-badcb3b4-e7ab-4963-99c4-0946a0358fe8 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:25.791396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-badcb3b4-e7ab-4963-99c4-0946a0358fe8 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:25.797806 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-badcb3b4-e7ab-4963-99c4-0946a0358fe8 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:25.798245 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-badcb3b4-e7ab-4963-99c4-0946a0358fe8 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:25.798990 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-badcb3b4-e7ab-4963-99c4-0946a0358fe8 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:25.799452 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-badcb3b4-e7ab-4963-99c4-0946a0358fe8 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:25.825953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-050d3aac-4a97-4ba6-b35f-3da485caf27d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:25.826664 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-050d3aac-4a97-4ba6-b35f-3da485caf27d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:25.832415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-050d3aac-4a97-4ba6-b35f-3da485caf27d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:25.832866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-050d3aac-4a97-4ba6-b35f-3da485caf27d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:25.833629 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-050d3aac-4a97-4ba6-b35f-3da485caf27d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:25.834064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-050d3aac-4a97-4ba6-b35f-3da485caf27d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:25.920803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-badcb3b4-e7ab-4963-99c4-0946a0358fe8 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:25.928202 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-badcb3b4-e7ab-4963-99c4-0946a0358fe8 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.141383 Aug 19 09:18:25.928776 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 121/227] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:25 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:25.965189 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-050d3aac-4a97-4ba6-b35f-3da485caf27d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:25.972859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-050d3aac-4a97-4ba6-b35f-3da485caf27d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.150542 Aug 19 09:18:25.973671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 107/228] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:25 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:26.396880 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-da289a2e-c74e-4b74-801a-5c0596b2dc0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:26.397486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-da289a2e-c74e-4b74-801a-5c0596b2dc0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:26.403383 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da289a2e-c74e-4b74-801a-5c0596b2dc0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:26.403836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da289a2e-c74e-4b74-801a-5c0596b2dc0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:26.405404 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da289a2e-c74e-4b74-801a-5c0596b2dc0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:26.405838 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da289a2e-c74e-4b74-801a-5c0596b2dc0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:26.522175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-da289a2e-c74e-4b74-801a-5c0596b2dc0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:26.530362 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-da289a2e-c74e-4b74-801a-5c0596b2dc0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:26.531905 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-da289a2e-c74e-4b74-801a-5c0596b2dc0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:26.532973 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-da289a2e-c74e-4b74-801a-5c0596b2dc0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.139765 Aug 19 09:18:26.533525 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 122/229] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:26 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:26.603039 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-75465c25-451d-4ea6-bbce-cf54ccd0291d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:26.603683 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-75465c25-451d-4ea6-bbce-cf54ccd0291d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:26.610175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-75465c25-451d-4ea6-bbce-cf54ccd0291d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:26.610598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-75465c25-451d-4ea6-bbce-cf54ccd0291d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:26.611443 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-75465c25-451d-4ea6-bbce-cf54ccd0291d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:26.611876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-75465c25-451d-4ea6-bbce-cf54ccd0291d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:26.734375 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-75465c25-451d-4ea6-bbce-cf54ccd0291d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:26.741758 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-75465c25-451d-4ea6-bbce-cf54ccd0291d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.142242 Aug 19 09:18:26.742319 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 108/230] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:26 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:26.945488 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-12b61f6e-cd71-4bd4-8d5a-a93873759681 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:26.946091 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-12b61f6e-cd71-4bd4-8d5a-a93873759681 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:26.952367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-12b61f6e-cd71-4bd4-8d5a-a93873759681 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:26.952803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-12b61f6e-cd71-4bd4-8d5a-a93873759681 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:26.953556 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-12b61f6e-cd71-4bd4-8d5a-a93873759681 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:26.953986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-12b61f6e-cd71-4bd4-8d5a-a93873759681 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:26.989625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0377b544-f0f1-42e6-9b96-0fe67816a374 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:26.990395 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0377b544-f0f1-42e6-9b96-0fe67816a374 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:26.996334 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0377b544-f0f1-42e6-9b96-0fe67816a374 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:26.996779 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0377b544-f0f1-42e6-9b96-0fe67816a374 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:26.997534 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0377b544-f0f1-42e6-9b96-0fe67816a374 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:26.998055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0377b544-f0f1-42e6-9b96-0fe67816a374 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:27.080081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-12b61f6e-cd71-4bd4-8d5a-a93873759681 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:27.087553 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-12b61f6e-cd71-4bd4-8d5a-a93873759681 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.145782 Aug 19 09:18:27.088119 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 123/231] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:26 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:27.123771 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0377b544-f0f1-42e6-9b96-0fe67816a374 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:27.130982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0377b544-f0f1-42e6-9b96-0fe67816a374 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.144912 Aug 19 09:18:27.131570 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 109/232] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:26 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:27.550398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a42e0865-fb63-42bc-b6ad-df33cc297ce0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:27.550904 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a42e0865-fb63-42bc-b6ad-df33cc297ce0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:27.557121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a42e0865-fb63-42bc-b6ad-df33cc297ce0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:27.557709 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a42e0865-fb63-42bc-b6ad-df33cc297ce0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:27.558460 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a42e0865-fb63-42bc-b6ad-df33cc297ce0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:27.558910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a42e0865-fb63-42bc-b6ad-df33cc297ce0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:27.681461 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a42e0865-fb63-42bc-b6ad-df33cc297ce0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:27.689781 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a42e0865-fb63-42bc-b6ad-df33cc297ce0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:27.691290 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a42e0865-fb63-42bc-b6ad-df33cc297ce0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:27.692367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a42e0865-fb63-42bc-b6ad-df33cc297ce0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.145720 Aug 19 09:18:27.692915 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 124/233] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:27 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:27.757774 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3908ad78-272d-406a-be7e-c1e1ddb79854 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:27.758404 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3908ad78-272d-406a-be7e-c1e1ddb79854 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:27.764397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3908ad78-272d-406a-be7e-c1e1ddb79854 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:27.764837 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3908ad78-272d-406a-be7e-c1e1ddb79854 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:27.765588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3908ad78-272d-406a-be7e-c1e1ddb79854 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:27.766011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3908ad78-272d-406a-be7e-c1e1ddb79854 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:27.887735 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3908ad78-272d-406a-be7e-c1e1ddb79854 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:27.895294 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3908ad78-272d-406a-be7e-c1e1ddb79854 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.141247 Aug 19 09:18:27.895856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 110/234] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:27 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:28.104962 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cb896229-1df7-4132-8ff8-90b31fc2cbaf tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:28.105476 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cb896229-1df7-4132-8ff8-90b31fc2cbaf tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:28.111250 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb896229-1df7-4132-8ff8-90b31fc2cbaf tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:28.111717 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb896229-1df7-4132-8ff8-90b31fc2cbaf tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:28.112462 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb896229-1df7-4132-8ff8-90b31fc2cbaf tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:28.112886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb896229-1df7-4132-8ff8-90b31fc2cbaf tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:28.148294 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-23a04b50-098b-4554-97da-0a825d56c8b1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:28.148983 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-23a04b50-098b-4554-97da-0a825d56c8b1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:28.155566 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-23a04b50-098b-4554-97da-0a825d56c8b1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:28.156009 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-23a04b50-098b-4554-97da-0a825d56c8b1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:28.156772 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-23a04b50-098b-4554-97da-0a825d56c8b1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:28.157196 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-23a04b50-098b-4554-97da-0a825d56c8b1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:28.238288 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cb896229-1df7-4132-8ff8-90b31fc2cbaf tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:28.245654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cb896229-1df7-4132-8ff8-90b31fc2cbaf tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.144338 Aug 19 09:18:28.246244 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 125/235] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:28 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:28.280739 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-23a04b50-098b-4554-97da-0a825d56c8b1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:28.288424 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-23a04b50-098b-4554-97da-0a825d56c8b1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.143900 Aug 19 09:18:28.288977 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 111/236] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:28 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:28.709608 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-eb41a318-ae86-4084-9df8-859b5d1d5505 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:28.710211 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-eb41a318-ae86-4084-9df8-859b5d1d5505 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:28.715844 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eb41a318-ae86-4084-9df8-859b5d1d5505 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:28.716286 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eb41a318-ae86-4084-9df8-859b5d1d5505 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:28.717245 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eb41a318-ae86-4084-9df8-859b5d1d5505 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:28.717497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eb41a318-ae86-4084-9df8-859b5d1d5505 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:28.838063 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-eb41a318-ae86-4084-9df8-859b5d1d5505 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:28.845770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-eb41a318-ae86-4084-9df8-859b5d1d5505 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:28.847254 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-eb41a318-ae86-4084-9df8-859b5d1d5505 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:28.848592 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-eb41a318-ae86-4084-9df8-859b5d1d5505 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.142366 Aug 19 09:18:28.849143 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 126/237] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:28 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:28.912641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-700ff561-b37e-4a9b-9c42-d68b37b63124 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:28.913181 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-700ff561-b37e-4a9b-9c42-d68b37b63124 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:28.918822 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-700ff561-b37e-4a9b-9c42-d68b37b63124 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:28.919264 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-700ff561-b37e-4a9b-9c42-d68b37b63124 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:28.920713 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-700ff561-b37e-4a9b-9c42-d68b37b63124 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:28.920999 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-700ff561-b37e-4a9b-9c42-d68b37b63124 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:29.041435 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-700ff561-b37e-4a9b-9c42-d68b37b63124 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:29.048515 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-700ff561-b37e-4a9b-9c42-d68b37b63124 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.139624 Aug 19 09:18:29.049064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 112/238] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:28 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:29.262357 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1fc11d33-d64c-4021-9c1b-86f93fb628fb tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:29.262962 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1fc11d33-d64c-4021-9c1b-86f93fb628fb tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:29.269500 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fc11d33-d64c-4021-9c1b-86f93fb628fb tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:29.269959 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fc11d33-d64c-4021-9c1b-86f93fb628fb tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:29.270749 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fc11d33-d64c-4021-9c1b-86f93fb628fb tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:29.271183 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1fc11d33-d64c-4021-9c1b-86f93fb628fb tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:29.304688 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b9d6d61f-b97b-4402-9faa-f2c5fcbe0ce9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:29.305293 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b9d6d61f-b97b-4402-9faa-f2c5fcbe0ce9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:29.311720 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b9d6d61f-b97b-4402-9faa-f2c5fcbe0ce9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:29.312167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b9d6d61f-b97b-4402-9faa-f2c5fcbe0ce9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:29.312932 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b9d6d61f-b97b-4402-9faa-f2c5fcbe0ce9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:29.313361 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b9d6d61f-b97b-4402-9faa-f2c5fcbe0ce9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:29.392703 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1fc11d33-d64c-4021-9c1b-86f93fb628fb tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:29.400210 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1fc11d33-d64c-4021-9c1b-86f93fb628fb tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.141451 Aug 19 09:18:29.400952 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 127/239] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:29 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:29.441045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b9d6d61f-b97b-4402-9faa-f2c5fcbe0ce9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:29.448115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b9d6d61f-b97b-4402-9faa-f2c5fcbe0ce9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.146961 Aug 19 09:18:29.448663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 113/240] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:29 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:29.866479 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-66356cc1-9f06-4032-a5be-c844146c1dac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:29.867084 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-66356cc1-9f06-4032-a5be-c844146c1dac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:29.873984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66356cc1-9f06-4032-a5be-c844146c1dac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:29.874446 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66356cc1-9f06-4032-a5be-c844146c1dac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:29.875209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66356cc1-9f06-4032-a5be-c844146c1dac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:29.875673 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66356cc1-9f06-4032-a5be-c844146c1dac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:29.995645 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-66356cc1-9f06-4032-a5be-c844146c1dac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:30.003384 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-66356cc1-9f06-4032-a5be-c844146c1dac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:30.004997 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-66356cc1-9f06-4032-a5be-c844146c1dac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:30.006154 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-66356cc1-9f06-4032-a5be-c844146c1dac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.143320 Aug 19 09:18:30.006795 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 128/241] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:29 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:30.064860 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6d6fd1ab-9134-4ba3-9433-9686943b20cf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:30.065473 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6d6fd1ab-9134-4ba3-9433-9686943b20cf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:30.071143 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6d6fd1ab-9134-4ba3-9433-9686943b20cf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:30.071622 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6d6fd1ab-9134-4ba3-9433-9686943b20cf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:30.072387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6d6fd1ab-9134-4ba3-9433-9686943b20cf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:30.072820 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6d6fd1ab-9134-4ba3-9433-9686943b20cf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:30.191642 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6d6fd1ab-9134-4ba3-9433-9686943b20cf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:30.198659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6d6fd1ab-9134-4ba3-9433-9686943b20cf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.137435 Aug 19 09:18:30.199214 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 114/242] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:30 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:30.416004 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c0934471-5002-4294-8f9e-a85a9c168255 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:30.416624 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c0934471-5002-4294-8f9e-a85a9c168255 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:30.422703 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c0934471-5002-4294-8f9e-a85a9c168255 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:30.423158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c0934471-5002-4294-8f9e-a85a9c168255 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:30.423953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c0934471-5002-4294-8f9e-a85a9c168255 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:30.424394 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c0934471-5002-4294-8f9e-a85a9c168255 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:30.465260 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-dcc83ab3-9903-4747-8501-0602e83b56a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:30.465950 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-dcc83ab3-9903-4747-8501-0602e83b56a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:30.472504 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcc83ab3-9903-4747-8501-0602e83b56a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:30.473210 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcc83ab3-9903-4747-8501-0602e83b56a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:30.473982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcc83ab3-9903-4747-8501-0602e83b56a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:30.474412 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcc83ab3-9903-4747-8501-0602e83b56a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:30.551726 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c0934471-5002-4294-8f9e-a85a9c168255 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:30.559231 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c0934471-5002-4294-8f9e-a85a9c168255 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.146825 Aug 19 09:18:30.559815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 129/243] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:30 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:30.596753 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dcc83ab3-9903-4747-8501-0602e83b56a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:30.604838 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-dcc83ab3-9903-4747-8501-0602e83b56a8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.143147 Aug 19 09:18:30.605396 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 115/244] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:30 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:31.024705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-66a42a88-fc88-4a3f-b319-fcc8f14a4641 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:31.025489 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-66a42a88-fc88-4a3f-b319-fcc8f14a4641 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:31.031468 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66a42a88-fc88-4a3f-b319-fcc8f14a4641 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:31.031909 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66a42a88-fc88-4a3f-b319-fcc8f14a4641 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:31.032665 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66a42a88-fc88-4a3f-b319-fcc8f14a4641 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:31.033091 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66a42a88-fc88-4a3f-b319-fcc8f14a4641 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:31.152089 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-66a42a88-fc88-4a3f-b319-fcc8f14a4641 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:31.159845 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-66a42a88-fc88-4a3f-b319-fcc8f14a4641 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:31.161353 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-66a42a88-fc88-4a3f-b319-fcc8f14a4641 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:31.162428 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-66a42a88-fc88-4a3f-b319-fcc8f14a4641 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.141444 Aug 19 09:18:31.162972 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 130/245] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:31 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:31.214643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4a4f3410-8afb-4b3b-bd23-7319f24f203a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:31.215245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4a4f3410-8afb-4b3b-bd23-7319f24f203a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:31.221109 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a4f3410-8afb-4b3b-bd23-7319f24f203a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:31.221556 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a4f3410-8afb-4b3b-bd23-7319f24f203a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:31.222305 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a4f3410-8afb-4b3b-bd23-7319f24f203a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:31.222732 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a4f3410-8afb-4b3b-bd23-7319f24f203a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:31.344081 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4a4f3410-8afb-4b3b-bd23-7319f24f203a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:31.351509 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4a4f3410-8afb-4b3b-bd23-7319f24f203a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.140387 Aug 19 09:18:31.352071 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 116/246] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:31 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:31.575544 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-eb46c94e-f3b3-4ff3-93b3-013c41bc5afd tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:31.576214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-eb46c94e-f3b3-4ff3-93b3-013c41bc5afd tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:31.582187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eb46c94e-f3b3-4ff3-93b3-013c41bc5afd tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:31.582626 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eb46c94e-f3b3-4ff3-93b3-013c41bc5afd tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:31.583414 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eb46c94e-f3b3-4ff3-93b3-013c41bc5afd tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:31.583845 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eb46c94e-f3b3-4ff3-93b3-013c41bc5afd tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:31.620571 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a213cb60-8a3e-46d3-a528-0d6a2b27e003 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:31.621291 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a213cb60-8a3e-46d3-a528-0d6a2b27e003 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:31.627127 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a213cb60-8a3e-46d3-a528-0d6a2b27e003 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:31.627614 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a213cb60-8a3e-46d3-a528-0d6a2b27e003 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:31.628397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a213cb60-8a3e-46d3-a528-0d6a2b27e003 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:31.628833 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a213cb60-8a3e-46d3-a528-0d6a2b27e003 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:31.710061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-eb46c94e-f3b3-4ff3-93b3-013c41bc5afd tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:31.717817 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-eb46c94e-f3b3-4ff3-93b3-013c41bc5afd tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.145791 Aug 19 09:18:31.718387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 131/247] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:31 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:31.748933 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a213cb60-8a3e-46d3-a528-0d6a2b27e003 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:31.756054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a213cb60-8a3e-46d3-a528-0d6a2b27e003 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.139188 Aug 19 09:18:31.756606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 117/248] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:31 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:32.180663 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3a938a87-3f60-4c26-b7fe-61845570cdd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:32.181274 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3a938a87-3f60-4c26-b7fe-61845570cdd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:32.188055 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a938a87-3f60-4c26-b7fe-61845570cdd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:32.188502 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a938a87-3f60-4c26-b7fe-61845570cdd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:32.189263 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a938a87-3f60-4c26-b7fe-61845570cdd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:32.189698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a938a87-3f60-4c26-b7fe-61845570cdd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:32.311121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3a938a87-3f60-4c26-b7fe-61845570cdd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:32.318620 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3a938a87-3f60-4c26-b7fe-61845570cdd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:32.320170 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3a938a87-3f60-4c26-b7fe-61845570cdd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:32.321239 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3a938a87-3f60-4c26-b7fe-61845570cdd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.144256 Aug 19 09:18:32.321780 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 132/249] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:32 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:32.368757 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-db532f48-85d1-4979-a666-a7b98b7923c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:32.369362 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-db532f48-85d1-4979-a666-a7b98b7923c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:32.375785 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-db532f48-85d1-4979-a666-a7b98b7923c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:32.376226 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-db532f48-85d1-4979-a666-a7b98b7923c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:32.376975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-db532f48-85d1-4979-a666-a7b98b7923c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:32.377401 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-db532f48-85d1-4979-a666-a7b98b7923c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:32.495588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-db532f48-85d1-4979-a666-a7b98b7923c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:32.503255 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-db532f48-85d1-4979-a666-a7b98b7923c9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.138032 Aug 19 09:18:32.503918 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 118/250] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:32 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:32.734567 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a2f1afc6-ecc5-4d27-bc35-405c2dbb506b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:32.735141 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a2f1afc6-ecc5-4d27-bc35-405c2dbb506b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:32.740910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2f1afc6-ecc5-4d27-bc35-405c2dbb506b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:32.741354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2f1afc6-ecc5-4d27-bc35-405c2dbb506b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:32.742108 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2f1afc6-ecc5-4d27-bc35-405c2dbb506b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:32.742538 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2f1afc6-ecc5-4d27-bc35-405c2dbb506b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:32.772362 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-52868f0c-3c17-4333-96ae-e693c776cddc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:32.773054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-52868f0c-3c17-4333-96ae-e693c776cddc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:32.778900 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-52868f0c-3c17-4333-96ae-e693c776cddc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:32.779368 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-52868f0c-3c17-4333-96ae-e693c776cddc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:32.780101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-52868f0c-3c17-4333-96ae-e693c776cddc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:32.780526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-52868f0c-3c17-4333-96ae-e693c776cddc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:32.864119 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a2f1afc6-ecc5-4d27-bc35-405c2dbb506b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:32.871806 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a2f1afc6-ecc5-4d27-bc35-405c2dbb506b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.141421 Aug 19 09:18:32.881884 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 133/251] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:32 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:32.905887 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-52868f0c-3c17-4333-96ae-e693c776cddc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:32.913251 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-52868f0c-3c17-4333-96ae-e693c776cddc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.144441 Aug 19 09:18:32.913803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 119/252] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:32 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:33.339683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-66e802aa-67d6-4c40-a554-fb4837a0196f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:33.340294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-66e802aa-67d6-4c40-a554-fb4837a0196f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:33.346532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66e802aa-67d6-4c40-a554-fb4837a0196f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:33.346976 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66e802aa-67d6-4c40-a554-fb4837a0196f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:33.347765 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66e802aa-67d6-4c40-a554-fb4837a0196f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:33.348456 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66e802aa-67d6-4c40-a554-fb4837a0196f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:33.465647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-66e802aa-67d6-4c40-a554-fb4837a0196f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:33.473704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-66e802aa-67d6-4c40-a554-fb4837a0196f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:33.475219 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-66e802aa-67d6-4c40-a554-fb4837a0196f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:33.476319 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-66e802aa-67d6-4c40-a554-fb4837a0196f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.140334 Aug 19 09:18:33.476876 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 134/253] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:33 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:33.521458 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-065dab56-fd1b-4f1d-b2fe-d07f00272195 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:33.522055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-065dab56-fd1b-4f1d-b2fe-d07f00272195 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:33.527760 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-065dab56-fd1b-4f1d-b2fe-d07f00272195 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:33.528129 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-065dab56-fd1b-4f1d-b2fe-d07f00272195 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:33.528975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-065dab56-fd1b-4f1d-b2fe-d07f00272195 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:33.529530 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-065dab56-fd1b-4f1d-b2fe-d07f00272195 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:33.647919 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-065dab56-fd1b-4f1d-b2fe-d07f00272195 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:33.655214 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-065dab56-fd1b-4f1d-b2fe-d07f00272195 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.137248 Aug 19 09:18:33.656182 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 120/254] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:33 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:33.888705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e079aeac-beee-4617-bce5-766795e05cab tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:33.889375 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e079aeac-beee-4617-bce5-766795e05cab tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:33.895233 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e079aeac-beee-4617-bce5-766795e05cab tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:33.895712 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e079aeac-beee-4617-bce5-766795e05cab tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:33.896488 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e079aeac-beee-4617-bce5-766795e05cab tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:33.896911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e079aeac-beee-4617-bce5-766795e05cab tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:33.929303 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-47d3540d-a4ee-4e0c-9d63-dc969772dcd5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:33.929909 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-47d3540d-a4ee-4e0c-9d63-dc969772dcd5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:33.935761 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47d3540d-a4ee-4e0c-9d63-dc969772dcd5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:33.936205 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47d3540d-a4ee-4e0c-9d63-dc969772dcd5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:33.936973 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47d3540d-a4ee-4e0c-9d63-dc969772dcd5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:33.937401 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47d3540d-a4ee-4e0c-9d63-dc969772dcd5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:34.022682 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e079aeac-beee-4617-bce5-766795e05cab tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:34.030712 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e079aeac-beee-4617-bce5-766795e05cab tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.145584 Aug 19 09:18:34.031387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 135/255] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:33 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:34.067713 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-47d3540d-a4ee-4e0c-9d63-dc969772dcd5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:34.074739 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-47d3540d-a4ee-4e0c-9d63-dc969772dcd5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.148911 Aug 19 09:18:34.075291 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 121/256] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:33 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:34.496408 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2446d4a3-dd77-4761-a98d-da9d1281dad3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:34.496988 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2446d4a3-dd77-4761-a98d-da9d1281dad3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:34.503322 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2446d4a3-dd77-4761-a98d-da9d1281dad3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:34.503768 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2446d4a3-dd77-4761-a98d-da9d1281dad3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:34.504514 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2446d4a3-dd77-4761-a98d-da9d1281dad3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:34.504940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2446d4a3-dd77-4761-a98d-da9d1281dad3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:34.624036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2446d4a3-dd77-4761-a98d-da9d1281dad3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:34.631565 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2446d4a3-dd77-4761-a98d-da9d1281dad3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:34.632984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2446d4a3-dd77-4761-a98d-da9d1281dad3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:34.634044 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2446d4a3-dd77-4761-a98d-da9d1281dad3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.141383 Aug 19 09:18:34.634592 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 136/257] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:34 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:34.671717 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bafd6c20-f0fd-4420-84db-977de7295017 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:34.672331 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bafd6c20-f0fd-4420-84db-977de7295017 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:34.678056 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bafd6c20-f0fd-4420-84db-977de7295017 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:34.678496 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bafd6c20-f0fd-4420-84db-977de7295017 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:34.679245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bafd6c20-f0fd-4420-84db-977de7295017 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:34.679694 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bafd6c20-f0fd-4420-84db-977de7295017 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:34.802430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bafd6c20-f0fd-4420-84db-977de7295017 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:34.809447 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bafd6c20-f0fd-4420-84db-977de7295017 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.141485 Aug 19 09:18:34.809994 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 122/258] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:34 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:35.047946 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1cab2122-f58e-4871-99fc-cfe6ac93fa02 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:35.048548 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1cab2122-f58e-4871-99fc-cfe6ac93fa02 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:35.054539 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cab2122-f58e-4871-99fc-cfe6ac93fa02 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:35.054979 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cab2122-f58e-4871-99fc-cfe6ac93fa02 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:35.055769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cab2122-f58e-4871-99fc-cfe6ac93fa02 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:35.056195 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cab2122-f58e-4871-99fc-cfe6ac93fa02 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:35.091407 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cdb7518a-8306-4b1d-93a4-83744a2cbaa6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:35.092198 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-cdb7518a-8306-4b1d-93a4-83744a2cbaa6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:35.098468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cdb7518a-8306-4b1d-93a4-83744a2cbaa6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:35.098908 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cdb7518a-8306-4b1d-93a4-83744a2cbaa6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:35.099804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cdb7518a-8306-4b1d-93a4-83744a2cbaa6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:35.100233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cdb7518a-8306-4b1d-93a4-83744a2cbaa6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:35.175174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1cab2122-f58e-4871-99fc-cfe6ac93fa02 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:35.182464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1cab2122-f58e-4871-99fc-cfe6ac93fa02 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.138793 Aug 19 09:18:35.183029 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 137/259] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:35 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:35.219505 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-cdb7518a-8306-4b1d-93a4-83744a2cbaa6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:35.226813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-cdb7518a-8306-4b1d-93a4-83744a2cbaa6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.139045 Aug 19 09:18:35.227386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 123/260] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:35 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:35.651556 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c96f5590-4afa-4658-8705-50044d59d330 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:35.652150 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c96f5590-4afa-4658-8705-50044d59d330 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:35.659030 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c96f5590-4afa-4658-8705-50044d59d330 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:35.659510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c96f5590-4afa-4658-8705-50044d59d330 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:35.660275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c96f5590-4afa-4658-8705-50044d59d330 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:35.660708 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c96f5590-4afa-4658-8705-50044d59d330 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:35.783641 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c96f5590-4afa-4658-8705-50044d59d330 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:35.791496 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c96f5590-4afa-4658-8705-50044d59d330 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:35.793047 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c96f5590-4afa-4658-8705-50044d59d330 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:35.794117 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c96f5590-4afa-4658-8705-50044d59d330 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.146291 Aug 19 09:18:35.795250 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 138/261] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:35 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:35.825503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4f15a149-ff2d-4032-bca9-4bc6cf83cebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:35.826255 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4f15a149-ff2d-4032-bca9-4bc6cf83cebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:35.832044 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4f15a149-ff2d-4032-bca9-4bc6cf83cebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:35.832490 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4f15a149-ff2d-4032-bca9-4bc6cf83cebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:35.833249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4f15a149-ff2d-4032-bca9-4bc6cf83cebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:35.833678 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4f15a149-ff2d-4032-bca9-4bc6cf83cebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:35.951966 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4f15a149-ff2d-4032-bca9-4bc6cf83cebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:35.959012 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4f15a149-ff2d-4032-bca9-4bc6cf83cebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.137123 Aug 19 09:18:35.959601 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 124/262] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:35 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:36.199103 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-13088ce0-c044-488c-a375-50be56f8bf83 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:36.199672 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-13088ce0-c044-488c-a375-50be56f8bf83 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:36.205490 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13088ce0-c044-488c-a375-50be56f8bf83 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:36.205934 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13088ce0-c044-488c-a375-50be56f8bf83 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:36.206691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13088ce0-c044-488c-a375-50be56f8bf83 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:36.207121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13088ce0-c044-488c-a375-50be56f8bf83 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:36.243808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-62b96c30-3ca7-4702-becd-0dc0a1d805bd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:36.244409 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-62b96c30-3ca7-4702-becd-0dc0a1d805bd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:36.250260 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62b96c30-3ca7-4702-becd-0dc0a1d805bd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:36.250698 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62b96c30-3ca7-4702-becd-0dc0a1d805bd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:36.251489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62b96c30-3ca7-4702-becd-0dc0a1d805bd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:36.251915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62b96c30-3ca7-4702-becd-0dc0a1d805bd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:36.327535 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-13088ce0-c044-488c-a375-50be56f8bf83 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:36.334726 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-13088ce0-c044-488c-a375-50be56f8bf83 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.139259 Aug 19 09:18:36.335297 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 139/263] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:36 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:36.375555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-62b96c30-3ca7-4702-becd-0dc0a1d805bd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:36.382745 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-62b96c30-3ca7-4702-becd-0dc0a1d805bd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.142535 Aug 19 09:18:36.383316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 125/264] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:36 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:36.812565 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b047e31d-aafa-4d8b-9fe8-7620737d901a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:36.813355 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b047e31d-aafa-4d8b-9fe8-7620737d901a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:36.820019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b047e31d-aafa-4d8b-9fe8-7620737d901a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:36.820507 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b047e31d-aafa-4d8b-9fe8-7620737d901a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:36.821212 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b047e31d-aafa-4d8b-9fe8-7620737d901a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:36.821633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b047e31d-aafa-4d8b-9fe8-7620737d901a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:36.941693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b047e31d-aafa-4d8b-9fe8-7620737d901a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:36.949324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b047e31d-aafa-4d8b-9fe8-7620737d901a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:36.950810 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b047e31d-aafa-4d8b-9fe8-7620737d901a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:36.951947 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b047e31d-aafa-4d8b-9fe8-7620737d901a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.143374 Aug 19 09:18:36.952678 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 140/265] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:36 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:36.976164 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-029db7bc-1b99-46c6-b906-db4183834bed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:36.976773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-029db7bc-1b99-46c6-b906-db4183834bed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:36.982654 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-029db7bc-1b99-46c6-b906-db4183834bed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:36.983872 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-029db7bc-1b99-46c6-b906-db4183834bed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:36.984644 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-029db7bc-1b99-46c6-b906-db4183834bed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:36.985250 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-029db7bc-1b99-46c6-b906-db4183834bed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:37.106504 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-029db7bc-1b99-46c6-b906-db4183834bed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:37.113826 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-029db7bc-1b99-46c6-b906-db4183834bed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.141481 Aug 19 09:18:37.114371 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 126/266] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:36 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:37.352895 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-41fde984-f880-4d48-93b0-15fb24b0c6df tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:37.353585 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-41fde984-f880-4d48-93b0-15fb24b0c6df tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:37.360186 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41fde984-f880-4d48-93b0-15fb24b0c6df tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:37.360636 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41fde984-f880-4d48-93b0-15fb24b0c6df tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:37.361398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41fde984-f880-4d48-93b0-15fb24b0c6df tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:37.361827 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41fde984-f880-4d48-93b0-15fb24b0c6df tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:37.399465 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3accdc02-b121-4822-adab-e61e3edc4e77 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:37.400073 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3accdc02-b121-4822-adab-e61e3edc4e77 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:37.406487 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3accdc02-b121-4822-adab-e61e3edc4e77 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:37.406938 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3accdc02-b121-4822-adab-e61e3edc4e77 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:37.407728 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3accdc02-b121-4822-adab-e61e3edc4e77 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:37.408163 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3accdc02-b121-4822-adab-e61e3edc4e77 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:37.486572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-41fde984-f880-4d48-93b0-15fb24b0c6df tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:37.493959 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-41fde984-f880-4d48-93b0-15fb24b0c6df tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.145683 Aug 19 09:18:37.494519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 141/267] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:37 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:37.528060 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3accdc02-b121-4822-adab-e61e3edc4e77 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:37.535529 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3accdc02-b121-4822-adab-e61e3edc4e77 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.139567 Aug 19 09:18:37.536118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 127/268] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:37 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:37.949837 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-7db6cc69-ae67-4979-9bac-c475e541ce11 req-99ca4162-0686-48b2-80ae-29090af667f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf", "name": "network-vif-plugged", "status": "completed", "tag": "0012aba4-1975-4e17-9e36-63ccd5b799da"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:18:37.951669 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:18:37.951669 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:18:37.959844 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-7db6cc69-ae67-4979-9bac-c475e541ce11 req-99ca4162-0686-48b2-80ae-29090af667f4 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:37.960493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-7db6cc69-ae67-4979-9bac-c475e541ce11 req-99ca4162-0686-48b2-80ae-29090af667f4 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:37.971456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e581acc4-85c0-448f-afef-59c53a9ed629 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:37.972239 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e581acc4-85c0-448f-afef-59c53a9ed629 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:37.979053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e581acc4-85c0-448f-afef-59c53a9ed629 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:37.979673 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e581acc4-85c0-448f-afef-59c53a9ed629 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:37.980305 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e581acc4-85c0-448f-afef-59c53a9ed629 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:37.980806 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e581acc4-85c0-448f-afef-59c53a9ed629 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:37.988154 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-7db6cc69-ae67-4979-9bac-c475e541ce11 req-99ca4162-0686-48b2-80ae-29090af667f4 service nova] Creating event network-vif-plugged:0012aba4-1975-4e17-9e36-63ccd5b799da for instance ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf on hv-cinder-77387 Aug 19 09:18:37.993749 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-7db6cc69-ae67-4979-9bac-c475e541ce11 req-99ca4162-0686-48b2-80ae-29090af667f4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107316 Aug 19 09:18:37.994566 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 142/269] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:18:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:18:38.138135 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1c87110d-54d9-460e-af9b-475f4f547b6a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:38.139227 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1c87110d-54d9-460e-af9b-475f4f547b6a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:38.147692 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1c87110d-54d9-460e-af9b-475f4f547b6a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:38.148508 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1c87110d-54d9-460e-af9b-475f4f547b6a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:38.150217 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e581acc4-85c0-448f-afef-59c53a9ed629 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:38.151054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1c87110d-54d9-460e-af9b-475f4f547b6a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:38.151955 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1c87110d-54d9-460e-af9b-475f4f547b6a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:38.169998 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e581acc4-85c0-448f-afef-59c53a9ed629 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:38.173679 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e581acc4-85c0-448f-afef-59c53a9ed629 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:38.178104 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e581acc4-85c0-448f-afef-59c53a9ed629 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.211110 Aug 19 09:18:38.187032 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 128/270] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:37 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:38.342121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1c87110d-54d9-460e-af9b-475f4f547b6a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:38.351115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1c87110d-54d9-460e-af9b-475f4f547b6a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.219660 Aug 19 09:18:38.352637 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 143/271] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:38 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:38.516047 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-fa08d2b5-8133-4c08-8d12-bdc5b3fdba3e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:38.516923 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-fa08d2b5-8133-4c08-8d12-bdc5b3fdba3e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:38.527105 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fa08d2b5-8133-4c08-8d12-bdc5b3fdba3e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:38.528649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fa08d2b5-8133-4c08-8d12-bdc5b3fdba3e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:38.530951 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fa08d2b5-8133-4c08-8d12-bdc5b3fdba3e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:38.543411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fa08d2b5-8133-4c08-8d12-bdc5b3fdba3e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:38.552054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-240c6c33-ecd6-4a8b-acda-086ac55435c1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:38.553597 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-240c6c33-ecd6-4a8b-acda-086ac55435c1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:38.559826 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-240c6c33-ecd6-4a8b-acda-086ac55435c1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:38.563491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-240c6c33-ecd6-4a8b-acda-086ac55435c1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:38.564859 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-240c6c33-ecd6-4a8b-acda-086ac55435c1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:38.566296 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-240c6c33-ecd6-4a8b-acda-086ac55435c1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:38.705271 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-fa08d2b5-8133-4c08-8d12-bdc5b3fdba3e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:38.714102 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-fa08d2b5-8133-4c08-8d12-bdc5b3fdba3e tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.204786 Aug 19 09:18:38.714745 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 129/272] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:38 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:38.716887 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-240c6c33-ecd6-4a8b-acda-086ac55435c1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:38.724892 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-240c6c33-ecd6-4a8b-acda-086ac55435c1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.176809 Aug 19 09:18:38.725445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 144/273] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:38 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:39.202455 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1bf1145a-2c05-4f9c-a5e4-61969e588d10 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:39.203059 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1bf1145a-2c05-4f9c-a5e4-61969e588d10 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:39.209116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1bf1145a-2c05-4f9c-a5e4-61969e588d10 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:39.211414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1bf1145a-2c05-4f9c-a5e4-61969e588d10 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:39.211414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1bf1145a-2c05-4f9c-a5e4-61969e588d10 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:39.211414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1bf1145a-2c05-4f9c-a5e4-61969e588d10 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:39.338193 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1bf1145a-2c05-4f9c-a5e4-61969e588d10 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:39.346841 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1bf1145a-2c05-4f9c-a5e4-61969e588d10 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:39.348967 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1bf1145a-2c05-4f9c-a5e4-61969e588d10 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:39.350262 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1bf1145a-2c05-4f9c-a5e4-61969e588d10 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.151653 Aug 19 09:18:39.359808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 130/274] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:39 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:39.368203 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-32e19809-5178-42ca-8bd4-6445afde665a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:39.368807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-32e19809-5178-42ca-8bd4-6445afde665a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:39.374968 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-32e19809-5178-42ca-8bd4-6445afde665a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:39.375445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-32e19809-5178-42ca-8bd4-6445afde665a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:39.376230 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-32e19809-5178-42ca-8bd4-6445afde665a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:39.376657 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-32e19809-5178-42ca-8bd4-6445afde665a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:39.506510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-32e19809-5178-42ca-8bd4-6445afde665a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:39.513594 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-32e19809-5178-42ca-8bd4-6445afde665a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.149715 Aug 19 09:18:39.514139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 145/275] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:39 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:39.729317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-226a8a8c-2838-47ce-b973-3b0417e7e164 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:39.729923 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-226a8a8c-2838-47ce-b973-3b0417e7e164 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:39.735648 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-226a8a8c-2838-47ce-b973-3b0417e7e164 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:39.736098 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-226a8a8c-2838-47ce-b973-3b0417e7e164 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:39.736863 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-226a8a8c-2838-47ce-b973-3b0417e7e164 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:39.737296 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-226a8a8c-2838-47ce-b973-3b0417e7e164 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:39.742194 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-288988ce-8f33-4e83-b7ad-dc170bdb0413 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:39.742676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-288988ce-8f33-4e83-b7ad-dc170bdb0413 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:39.749651 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-288988ce-8f33-4e83-b7ad-dc170bdb0413 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:39.750337 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-288988ce-8f33-4e83-b7ad-dc170bdb0413 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:39.751171 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-288988ce-8f33-4e83-b7ad-dc170bdb0413 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:39.751758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-288988ce-8f33-4e83-b7ad-dc170bdb0413 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:39.866165 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-226a8a8c-2838-47ce-b973-3b0417e7e164 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:39.873305 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-226a8a8c-2838-47ce-b973-3b0417e7e164 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.147488 Aug 19 09:18:39.874446 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 131/276] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:39 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:39.883066 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-288988ce-8f33-4e83-b7ad-dc170bdb0413 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:39.890900 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-288988ce-8f33-4e83-b7ad-dc170bdb0413 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.152786 Aug 19 09:18:39.891465 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 146/277] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:39 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:40.011177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-eebdd885-47da-4682-be5d-53d4c8cbe89d req-9ef03021-9a64-47ad-8726-0ea16a5cf06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed06d0a-7ee6-4f00-b470-b19d7331667c", "name": "network-vif-plugged", "status": "completed", "tag": "137293e7-3590-4eee-8e9a-b01076e25605"}, {"server_uuid": "f4c3bc8f-45ae-4a40-8a3d-d9642d8728df", "name": "network-vif-plugged", "status": "completed", "tag": "ac485851-543b-4b61-ba46-32cc68fcf2c4"}, {"server_uuid": "728c5e2b-27f2-4879-b35b-7b814e6dca52", "name": "network-vif-plugged", "status": "completed", "tag": "d13f978a-34d4-4492-ad11-9cefbdb91dcc"}, {"server_uuid": "e7d8a445-b5d9-4394-955e-6b57dda71720", "name": "network-vif-plugged", "status": "completed", "tag": "fe32dc17-332d-4b18-91b9-52ea978ffebd"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:18:40.013357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:18:40.013357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:18:40.022417 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-eebdd885-47da-4682-be5d-53d4c8cbe89d req-9ef03021-9a64-47ad-8726-0ea16a5cf06e service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:40.022851 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-eebdd885-47da-4682-be5d-53d4c8cbe89d req-9ef03021-9a64-47ad-8726-0ea16a5cf06e service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:40.037522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-eebdd885-47da-4682-be5d-53d4c8cbe89d req-9ef03021-9a64-47ad-8726-0ea16a5cf06e service nova] Creating event network-vif-plugged:137293e7-3590-4eee-8e9a-b01076e25605 for instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c on hv-cinder-77387 Aug 19 09:18:40.038024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-eebdd885-47da-4682-be5d-53d4c8cbe89d req-9ef03021-9a64-47ad-8726-0ea16a5cf06e service nova] Creating event network-vif-plugged:ac485851-543b-4b61-ba46-32cc68fcf2c4 for instance f4c3bc8f-45ae-4a40-8a3d-d9642d8728df on hv-cinder-77387 Aug 19 09:18:40.038516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-eebdd885-47da-4682-be5d-53d4c8cbe89d req-9ef03021-9a64-47ad-8726-0ea16a5cf06e service nova] Creating event network-vif-plugged:d13f978a-34d4-4492-ad11-9cefbdb91dcc for instance 728c5e2b-27f2-4879-b35b-7b814e6dca52 on hv-cinder-77387 Aug 19 09:18:40.039016 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-eebdd885-47da-4682-be5d-53d4c8cbe89d req-9ef03021-9a64-47ad-8726-0ea16a5cf06e service nova] Creating event network-vif-plugged:fe32dc17-332d-4b18-91b9-52ea978ffebd for instance e7d8a445-b5d9-4394-955e-6b57dda71720 on hv-cinder-77387 Aug 19 09:18:40.049335 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-eebdd885-47da-4682-be5d-53d4c8cbe89d req-9ef03021-9a64-47ad-8726-0ea16a5cf06e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.041730 Aug 19 09:18:40.050104 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 132/278] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:18:40 2021] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:18:40.369512 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0c34bfe2-ac97-4897-bbed-a58b7ac54091 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:40.370205 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0c34bfe2-ac97-4897-bbed-a58b7ac54091 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:40.385016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c34bfe2-ac97-4897-bbed-a58b7ac54091 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:40.385586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c34bfe2-ac97-4897-bbed-a58b7ac54091 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:40.386442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c34bfe2-ac97-4897-bbed-a58b7ac54091 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:40.387671 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c34bfe2-ac97-4897-bbed-a58b7ac54091 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:40.531404 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-df017d5e-3e85-4c4f-87d1-2177d1ba5c31 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:40.532097 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-df017d5e-3e85-4c4f-87d1-2177d1ba5c31 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:40.539430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-df017d5e-3e85-4c4f-87d1-2177d1ba5c31 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:40.540210 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-df017d5e-3e85-4c4f-87d1-2177d1ba5c31 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:40.541233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-df017d5e-3e85-4c4f-87d1-2177d1ba5c31 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:40.541661 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-df017d5e-3e85-4c4f-87d1-2177d1ba5c31 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:40.574713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0c34bfe2-ac97-4897-bbed-a58b7ac54091 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:40.583008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0c34bfe2-ac97-4897-bbed-a58b7ac54091 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:40.584548 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0c34bfe2-ac97-4897-bbed-a58b7ac54091 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:40.585630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0c34bfe2-ac97-4897-bbed-a58b7ac54091 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.220498 Aug 19 09:18:40.586419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 147/279] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:40 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:40.739107 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-df017d5e-3e85-4c4f-87d1-2177d1ba5c31 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:40.746731 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-df017d5e-3e85-4c4f-87d1-2177d1ba5c31 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.220461 Aug 19 09:18:40.747311 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 133/280] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:40 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:40.889738 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5f33893f-3905-4310-9fea-801d5be4d5c1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:40.890349 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5f33893f-3905-4310-9fea-801d5be4d5c1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:40.896146 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f33893f-3905-4310-9fea-801d5be4d5c1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:40.896619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f33893f-3905-4310-9fea-801d5be4d5c1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:40.897380 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f33893f-3905-4310-9fea-801d5be4d5c1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:40.897814 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f33893f-3905-4310-9fea-801d5be4d5c1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:40.907577 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d919bea6-aa92-42fb-8e15-d0a56f29b94f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:40.908222 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d919bea6-aa92-42fb-8e15-d0a56f29b94f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:40.913972 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d919bea6-aa92-42fb-8e15-d0a56f29b94f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:40.914427 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d919bea6-aa92-42fb-8e15-d0a56f29b94f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:40.915217 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d919bea6-aa92-42fb-8e15-d0a56f29b94f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:40.915840 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d919bea6-aa92-42fb-8e15-d0a56f29b94f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:41.029149 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5f33893f-3905-4310-9fea-801d5be4d5c1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:41.038703 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5f33893f-3905-4310-9fea-801d5be4d5c1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.152542 Aug 19 09:18:41.039317 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 148/281] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:40 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:41.056708 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d919bea6-aa92-42fb-8e15-d0a56f29b94f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:41.064113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d919bea6-aa92-42fb-8e15-d0a56f29b94f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.160457 Aug 19 09:18:41.065072 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 134/282] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:40 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:41.604014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5c9abeac-0170-41e3-93e2-8ad414af2cfb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:41.604643 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5c9abeac-0170-41e3-93e2-8ad414af2cfb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:41.611120 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c9abeac-0170-41e3-93e2-8ad414af2cfb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:41.611594 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c9abeac-0170-41e3-93e2-8ad414af2cfb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:41.612348 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c9abeac-0170-41e3-93e2-8ad414af2cfb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:41.612776 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c9abeac-0170-41e3-93e2-8ad414af2cfb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:41.741081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5c9abeac-0170-41e3-93e2-8ad414af2cfb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:41.749326 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5c9abeac-0170-41e3-93e2-8ad414af2cfb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:41.750821 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5c9abeac-0170-41e3-93e2-8ad414af2cfb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:41.751924 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5c9abeac-0170-41e3-93e2-8ad414af2cfb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.151546 Aug 19 09:18:41.752466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 149/283] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:41 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:18:41.765588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-aa657a9a-ddbb-43d8-9dca-da0d42ace41c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:41.766745 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-aa657a9a-ddbb-43d8-9dca-da0d42ace41c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:41.772629 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aa657a9a-ddbb-43d8-9dca-da0d42ace41c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:41.773152 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aa657a9a-ddbb-43d8-9dca-da0d42ace41c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:41.773985 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aa657a9a-ddbb-43d8-9dca-da0d42ace41c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:41.774497 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aa657a9a-ddbb-43d8-9dca-da0d42ace41c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:41.893481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-aa657a9a-ddbb-43d8-9dca-da0d42ace41c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:41.900658 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-aa657a9a-ddbb-43d8-9dca-da0d42ace41c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.138987 Aug 19 09:18:41.901231 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 135/284] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:41 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:42.055501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2a2be510-89f8-49c7-8954-23f9cba0399d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:42.056665 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2a2be510-89f8-49c7-8954-23f9cba0399d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:42.062706 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2a2be510-89f8-49c7-8954-23f9cba0399d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:42.063155 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2a2be510-89f8-49c7-8954-23f9cba0399d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:42.063951 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2a2be510-89f8-49c7-8954-23f9cba0399d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:42.064385 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2a2be510-89f8-49c7-8954-23f9cba0399d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:42.080552 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e0ca4cc0-1131-41af-b99d-cf02bc36ef6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:42.081416 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e0ca4cc0-1131-41af-b99d-cf02bc36ef6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:42.087939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e0ca4cc0-1131-41af-b99d-cf02bc36ef6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:42.088550 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e0ca4cc0-1131-41af-b99d-cf02bc36ef6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:42.089485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e0ca4cc0-1131-41af-b99d-cf02bc36ef6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:42.090063 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e0ca4cc0-1131-41af-b99d-cf02bc36ef6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:42.200042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2a2be510-89f8-49c7-8954-23f9cba0399d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:42.208391 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2a2be510-89f8-49c7-8954-23f9cba0399d tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.156498 Aug 19 09:18:42.210101 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 150/285] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:42 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:42.242354 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e0ca4cc0-1131-41af-b99d-cf02bc36ef6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:42.250605 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e0ca4cc0-1131-41af-b99d-cf02bc36ef6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.173733 Aug 19 09:18:42.251168 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 136/286] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:42 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:42.769401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-59883c05-aa9e-4741-9970-eb3e36c3abc6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:42.770006 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-59883c05-aa9e-4741-9970-eb3e36c3abc6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:42.775810 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-59883c05-aa9e-4741-9970-eb3e36c3abc6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:42.776251 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-59883c05-aa9e-4741-9970-eb3e36c3abc6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:42.777003 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-59883c05-aa9e-4741-9970-eb3e36c3abc6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:42.777431 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-59883c05-aa9e-4741-9970-eb3e36c3abc6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:42.898099 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-59883c05-aa9e-4741-9970-eb3e36c3abc6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:42.906047 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-59883c05-aa9e-4741-9970-eb3e36c3abc6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:42.907522 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-59883c05-aa9e-4741-9970-eb3e36c3abc6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:42.908773 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-59883c05-aa9e-4741-9970-eb3e36c3abc6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.143123 Aug 19 09:18:42.909304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 151/287] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:42 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:18:42.917764 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e109c377-4a51-42d2-bb36-b0522bb9ed76 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:42.918377 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e109c377-4a51-42d2-bb36-b0522bb9ed76 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:42.924316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e109c377-4a51-42d2-bb36-b0522bb9ed76 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:42.924870 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e109c377-4a51-42d2-bb36-b0522bb9ed76 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:42.925523 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e109c377-4a51-42d2-bb36-b0522bb9ed76 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:42.925960 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e109c377-4a51-42d2-bb36-b0522bb9ed76 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:43.049106 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e109c377-4a51-42d2-bb36-b0522bb9ed76 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:43.056402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e109c377-4a51-42d2-bb36-b0522bb9ed76 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.142443 Aug 19 09:18:43.057036 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 137/288] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:42 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:43.237178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-622534ac-db22-45ed-9a9a-a7a2e6e55663 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:43.237930 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-622534ac-db22-45ed-9a9a-a7a2e6e55663 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:43.245806 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-622534ac-db22-45ed-9a9a-a7a2e6e55663 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:43.246016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-622534ac-db22-45ed-9a9a-a7a2e6e55663 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:43.246791 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-622534ac-db22-45ed-9a9a-a7a2e6e55663 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:43.247258 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-622534ac-db22-45ed-9a9a-a7a2e6e55663 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:43.266847 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-24622fe7-8595-4607-9c99-33598d678319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:43.267354 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-24622fe7-8595-4607-9c99-33598d678319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:43.275954 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24622fe7-8595-4607-9c99-33598d678319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:43.277385 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24622fe7-8595-4607-9c99-33598d678319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:43.278639 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24622fe7-8595-4607-9c99-33598d678319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:43.279292 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24622fe7-8595-4607-9c99-33598d678319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:43.404505 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-622534ac-db22-45ed-9a9a-a7a2e6e55663 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:43.415047 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-622534ac-db22-45ed-9a9a-a7a2e6e55663 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.182207 Aug 19 09:18:43.425261 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 152/289] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:43 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:43.437280 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-24622fe7-8595-4607-9c99-33598d678319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:43.445056 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-24622fe7-8595-4607-9c99-33598d678319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.182402 Aug 19 09:18:43.445717 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 138/290] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:43 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:43.926088 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-18313246-41f8-499b-af03-d24f174fbc21 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:43.926690 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-18313246-41f8-499b-af03-d24f174fbc21 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:43.932602 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18313246-41f8-499b-af03-d24f174fbc21 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:43.932982 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18313246-41f8-499b-af03-d24f174fbc21 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:43.933747 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18313246-41f8-499b-af03-d24f174fbc21 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:43.934173 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18313246-41f8-499b-af03-d24f174fbc21 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:44.062497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-18313246-41f8-499b-af03-d24f174fbc21 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:44.070186 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-18313246-41f8-499b-af03-d24f174fbc21 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:44.071726 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-18313246-41f8-499b-af03-d24f174fbc21 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:44.072807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-18313246-41f8-499b-af03-d24f174fbc21 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.150383 Aug 19 09:18:44.073336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 153/291] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:43 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:44.073882 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-33ffdbb9-e902-4a6c-888b-ea6548cd28d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:44.075223 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-33ffdbb9-e902-4a6c-888b-ea6548cd28d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:44.081920 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33ffdbb9-e902-4a6c-888b-ea6548cd28d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:44.082378 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33ffdbb9-e902-4a6c-888b-ea6548cd28d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:44.083141 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33ffdbb9-e902-4a6c-888b-ea6548cd28d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:44.083600 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-33ffdbb9-e902-4a6c-888b-ea6548cd28d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:44.207464 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-33ffdbb9-e902-4a6c-888b-ea6548cd28d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:44.214467 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-33ffdbb9-e902-4a6c-888b-ea6548cd28d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.144405 Aug 19 09:18:44.215023 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 139/292] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:44 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:44.432054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f22b46cc-3279-4846-815c-365650764ac7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:44.432656 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f22b46cc-3279-4846-815c-365650764ac7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:44.438919 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f22b46cc-3279-4846-815c-365650764ac7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:44.439369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f22b46cc-3279-4846-815c-365650764ac7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:44.440178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f22b46cc-3279-4846-815c-365650764ac7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:44.440679 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f22b46cc-3279-4846-815c-365650764ac7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:44.476202 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-32f351e8-e746-4d17-bdd5-a65a78229092 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:44.477884 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-32f351e8-e746-4d17-bdd5-a65a78229092 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:44.486230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-32f351e8-e746-4d17-bdd5-a65a78229092 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:44.486904 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-32f351e8-e746-4d17-bdd5-a65a78229092 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:44.488009 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-32f351e8-e746-4d17-bdd5-a65a78229092 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:44.488682 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-32f351e8-e746-4d17-bdd5-a65a78229092 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:44.577581 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f22b46cc-3279-4846-815c-365650764ac7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:44.584718 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f22b46cc-3279-4846-815c-365650764ac7 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.156466 Aug 19 09:18:44.585445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 154/293] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:44 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:44.618817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-32f351e8-e746-4d17-bdd5-a65a78229092 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:44.626026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-32f351e8-e746-4d17-bdd5-a65a78229092 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.167678 Aug 19 09:18:44.626576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 140/294] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:44 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:45.089734 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4b061288-f589-426f-a6e2-96889c1b6af5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:45.090338 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4b061288-f589-426f-a6e2-96889c1b6af5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:45.096434 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b061288-f589-426f-a6e2-96889c1b6af5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:45.096881 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b061288-f589-426f-a6e2-96889c1b6af5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:45.097635 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b061288-f589-426f-a6e2-96889c1b6af5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:45.098312 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b061288-f589-426f-a6e2-96889c1b6af5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:45.219242 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4b061288-f589-426f-a6e2-96889c1b6af5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:45.227297 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4b061288-f589-426f-a6e2-96889c1b6af5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:45.228777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4b061288-f589-426f-a6e2-96889c1b6af5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:45.229846 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4b061288-f589-426f-a6e2-96889c1b6af5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.143840 Aug 19 09:18:45.230386 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 155/295] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:45 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:45.231931 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-990bc3f9-14a6-4469-88a4-0348160d8cb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:45.232633 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-990bc3f9-14a6-4469-88a4-0348160d8cb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:45.238672 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-990bc3f9-14a6-4469-88a4-0348160d8cb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:45.239113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-990bc3f9-14a6-4469-88a4-0348160d8cb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:45.239903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-990bc3f9-14a6-4469-88a4-0348160d8cb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:45.240338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-990bc3f9-14a6-4469-88a4-0348160d8cb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:45.363496 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-990bc3f9-14a6-4469-88a4-0348160d8cb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:45.370448 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-990bc3f9-14a6-4469-88a4-0348160d8cb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.142151 Aug 19 09:18:45.371004 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 141/296] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:45 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:45.601760 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-048752ad-3e7b-4336-abc2-82908da1413b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:45.602488 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-048752ad-3e7b-4336-abc2-82908da1413b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:45.609100 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-048752ad-3e7b-4336-abc2-82908da1413b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:45.609242 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-048752ad-3e7b-4336-abc2-82908da1413b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:45.609949 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-048752ad-3e7b-4336-abc2-82908da1413b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:45.610378 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-048752ad-3e7b-4336-abc2-82908da1413b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:45.644801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4139b8c3-be55-4cb9-a259-ec0d843f01b3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:45.644801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4139b8c3-be55-4cb9-a259-ec0d843f01b3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:45.650073 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4139b8c3-be55-4cb9-a259-ec0d843f01b3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:45.654506 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4139b8c3-be55-4cb9-a259-ec0d843f01b3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:45.654506 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4139b8c3-be55-4cb9-a259-ec0d843f01b3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:45.654506 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4139b8c3-be55-4cb9-a259-ec0d843f01b3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:45.752557 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-048752ad-3e7b-4336-abc2-82908da1413b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:45.761158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-048752ad-3e7b-4336-abc2-82908da1413b tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.163315 Aug 19 09:18:45.761811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 156/297] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:45 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:45.793049 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4139b8c3-be55-4cb9-a259-ec0d843f01b3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:45.800892 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4139b8c3-be55-4cb9-a259-ec0d843f01b3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1322 microversion: 2.1 time: 0.162255 Aug 19 09:18:45.801400 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 142/298] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:45 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:46.247351 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5fac5702-e84a-42c7-ac86-d2ba48cad227 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:46.247960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5fac5702-e84a-42c7-ac86-d2ba48cad227 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:46.253633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5fac5702-e84a-42c7-ac86-d2ba48cad227 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:46.254083 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5fac5702-e84a-42c7-ac86-d2ba48cad227 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:46.254841 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5fac5702-e84a-42c7-ac86-d2ba48cad227 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:46.255299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5fac5702-e84a-42c7-ac86-d2ba48cad227 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:46.375336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5fac5702-e84a-42c7-ac86-d2ba48cad227 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:46.382964 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5fac5702-e84a-42c7-ac86-d2ba48cad227 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:46.384491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5fac5702-e84a-42c7-ac86-d2ba48cad227 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:46.385565 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5fac5702-e84a-42c7-ac86-d2ba48cad227 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.141954 Aug 19 09:18:46.386102 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 157/299] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:46 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:46.387187 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8700b272-1c22-4c90-9f9f-52e49ae4f2d1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:46.387822 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8700b272-1c22-4c90-9f9f-52e49ae4f2d1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:46.394212 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8700b272-1c22-4c90-9f9f-52e49ae4f2d1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:46.394650 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8700b272-1c22-4c90-9f9f-52e49ae4f2d1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:46.395441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8700b272-1c22-4c90-9f9f-52e49ae4f2d1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:46.395869 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8700b272-1c22-4c90-9f9f-52e49ae4f2d1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:46.512948 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8700b272-1c22-4c90-9f9f-52e49ae4f2d1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:46.520621 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8700b272-1c22-4c90-9f9f-52e49ae4f2d1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.136962 Aug 19 09:18:46.521180 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 143/300] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:46 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:46.777460 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-699d2105-8b57-4339-a334-2c0224789a41 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:46.777995 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-699d2105-8b57-4339-a334-2c0224789a41 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:46.784054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-699d2105-8b57-4339-a334-2c0224789a41 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:46.784501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-699d2105-8b57-4339-a334-2c0224789a41 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:46.785333 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-699d2105-8b57-4339-a334-2c0224789a41 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:46.785767 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-699d2105-8b57-4339-a334-2c0224789a41 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:46.817929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c5012704-ab18-426c-ac97-738686668baa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:46.818563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c5012704-ab18-426c-ac97-738686668baa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:46.824416 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c5012704-ab18-426c-ac97-738686668baa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:46.824865 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c5012704-ab18-426c-ac97-738686668baa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:46.825634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c5012704-ab18-426c-ac97-738686668baa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:46.826071 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c5012704-ab18-426c-ac97-738686668baa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:46.905410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-699d2105-8b57-4339-a334-2c0224789a41 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:46.912645 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-699d2105-8b57-4339-a334-2c0224789a41 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.138961 Aug 19 09:18:46.913235 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 158/301] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:46 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:46.948026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c5012704-ab18-426c-ac97-738686668baa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:46.955426 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c5012704-ab18-426c-ac97-738686668baa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1517 microversion: 2.1 time: 0.141095 Aug 19 09:18:46.955978 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 144/302] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:46 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1517 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:46.972342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0d04daa0-b1f7-4016-9b44-01048aaa0d02 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:18:46.973593 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0d04daa0-b1f7-4016-9b44-01048aaa0d02 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:46.979232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d04daa0-b1f7-4016-9b44-01048aaa0d02 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:46.979701 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d04daa0-b1f7-4016-9b44-01048aaa0d02 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:46.981268 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d04daa0-b1f7-4016-9b44-01048aaa0d02 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:46.981268 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d04daa0-b1f7-4016-9b44-01048aaa0d02 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:47.046395 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-0d04daa0-b1f7-4016-9b44-01048aaa0d02 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lazy-loading 'flavor' on Instance uuid ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:18:47.169684 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0d04daa0-b1f7-4016-9b44-01048aaa0d02 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "POST /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf/action" status: 200 len: 32 microversion: 2.1 time: 0.201359 Aug 19 09:18:47.170432 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 159/303] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:18:46 2021] POST /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 19 09:18:47.179755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-35981c3d-96fb-4a88-8e61-aef14c495282 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:47.180485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-35981c3d-96fb-4a88-8e61-aef14c495282 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:47.186763 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-35981c3d-96fb-4a88-8e61-aef14c495282 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:47.187291 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-35981c3d-96fb-4a88-8e61-aef14c495282 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:47.188114 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-35981c3d-96fb-4a88-8e61-aef14c495282 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:47.188611 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-35981c3d-96fb-4a88-8e61-aef14c495282 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:47.311966 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-35981c3d-96fb-4a88-8e61-aef14c495282 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:47.319101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-35981c3d-96fb-4a88-8e61-aef14c495282 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.143186 Aug 19 09:18:47.319840 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 145/304] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:47 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:47.405175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-90830708-8447-4fbb-b9a3-43712d4d1762 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:47.405825 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-90830708-8447-4fbb-b9a3-43712d4d1762 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:47.411951 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-90830708-8447-4fbb-b9a3-43712d4d1762 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:47.412400 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-90830708-8447-4fbb-b9a3-43712d4d1762 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:47.413191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-90830708-8447-4fbb-b9a3-43712d4d1762 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:47.413622 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-90830708-8447-4fbb-b9a3-43712d4d1762 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:47.537161 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cc52dfd2-6223-44c9-ad67-0203c620c77c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:47.538532 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-cc52dfd2-6223-44c9-ad67-0203c620c77c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:47.546390 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cc52dfd2-6223-44c9-ad67-0203c620c77c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:47.547364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cc52dfd2-6223-44c9-ad67-0203c620c77c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:47.548793 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cc52dfd2-6223-44c9-ad67-0203c620c77c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:47.549332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cc52dfd2-6223-44c9-ad67-0203c620c77c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:47.558514 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-90830708-8447-4fbb-b9a3-43712d4d1762 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:47.567631 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-90830708-8447-4fbb-b9a3-43712d4d1762 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:47.569210 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-90830708-8447-4fbb-b9a3-43712d4d1762 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:47.570951 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-90830708-8447-4fbb-b9a3-43712d4d1762 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.170282 Aug 19 09:18:47.571545 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 160/305] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:47 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:18:47.928850 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2d352111-6a3f-40bc-b17d-4cd7d2250537 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:47.929601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2d352111-6a3f-40bc-b17d-4cd7d2250537 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:47.935749 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d352111-6a3f-40bc-b17d-4cd7d2250537 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:47.936401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d352111-6a3f-40bc-b17d-4cd7d2250537 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:47.937376 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d352111-6a3f-40bc-b17d-4cd7d2250537 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:47.938033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d352111-6a3f-40bc-b17d-4cd7d2250537 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:47.954711 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-cc52dfd2-6223-44c9-ad67-0203c620c77c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:47.973024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-cc52dfd2-6223-44c9-ad67-0203c620c77c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.439599 Aug 19 09:18:47.977332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 146/306] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:47 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:48.133996 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2d352111-6a3f-40bc-b17d-4cd7d2250537 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:48.141595 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2d352111-6a3f-40bc-b17d-4cd7d2250537 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.216332 Aug 19 09:18:48.142156 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 161/307] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:47 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:48.336798 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-25afa313-7bca-4aea-9b14-34d436c5369a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:48.337936 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-25afa313-7bca-4aea-9b14-34d436c5369a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:48.345145 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-25afa313-7bca-4aea-9b14-34d436c5369a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:48.345788 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-25afa313-7bca-4aea-9b14-34d436c5369a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:48.346723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-25afa313-7bca-4aea-9b14-34d436c5369a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:48.347155 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-25afa313-7bca-4aea-9b14-34d436c5369a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:48.480608 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-25afa313-7bca-4aea-9b14-34d436c5369a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:48.488503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-25afa313-7bca-4aea-9b14-34d436c5369a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.155492 Aug 19 09:18:48.489609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 147/308] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:48 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:48.587774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c1c4575a-a061-458d-80f6-531ffa8df878 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:48.588333 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c1c4575a-a061-458d-80f6-531ffa8df878 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:48.595018 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1c4575a-a061-458d-80f6-531ffa8df878 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:48.595516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1c4575a-a061-458d-80f6-531ffa8df878 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:48.596286 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1c4575a-a061-458d-80f6-531ffa8df878 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:48.596723 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1c4575a-a061-458d-80f6-531ffa8df878 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:48.728008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c1c4575a-a061-458d-80f6-531ffa8df878 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:48.737546 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c1c4575a-a061-458d-80f6-531ffa8df878 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:48.739066 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c1c4575a-a061-458d-80f6-531ffa8df878 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:48.740224 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c1c4575a-a061-458d-80f6-531ffa8df878 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.156236 Aug 19 09:18:48.740774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 162/309] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:48 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:48.995979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b2ad5e23-af11-4ad4-8bf4-2f568669ff17 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:48.997238 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b2ad5e23-af11-4ad4-8bf4-2f568669ff17 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:49.003857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2ad5e23-af11-4ad4-8bf4-2f568669ff17 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:49.004624 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2ad5e23-af11-4ad4-8bf4-2f568669ff17 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:49.005561 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2ad5e23-af11-4ad4-8bf4-2f568669ff17 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:49.005998 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2ad5e23-af11-4ad4-8bf4-2f568669ff17 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:49.141379 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b2ad5e23-af11-4ad4-8bf4-2f568669ff17 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:49.148980 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b2ad5e23-af11-4ad4-8bf4-2f568669ff17 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.157872 Aug 19 09:18:49.149539 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 148/310] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:48 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:49.157739 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3a379451-52fc-48c3-accf-a99fd4f5a1a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:49.158488 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3a379451-52fc-48c3-accf-a99fd4f5a1a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:49.164282 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a379451-52fc-48c3-accf-a99fd4f5a1a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:49.164726 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a379451-52fc-48c3-accf-a99fd4f5a1a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:49.165644 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a379451-52fc-48c3-accf-a99fd4f5a1a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:49.166083 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a379451-52fc-48c3-accf-a99fd4f5a1a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:49.305493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3a379451-52fc-48c3-accf-a99fd4f5a1a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:49.313638 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3a379451-52fc-48c3-accf-a99fd4f5a1a3 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1315 microversion: 2.1 time: 0.159466 Aug 19 09:18:49.314205 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 163/311] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:49 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:49.507158 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b642f169-c334-4594-afad-8b291c5c9750 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:49.507867 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b642f169-c334-4594-afad-8b291c5c9750 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:49.513587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b642f169-c334-4594-afad-8b291c5c9750 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:49.514314 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b642f169-c334-4594-afad-8b291c5c9750 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:49.514903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b642f169-c334-4594-afad-8b291c5c9750 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:49.515358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b642f169-c334-4594-afad-8b291c5c9750 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:49.664189 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b642f169-c334-4594-afad-8b291c5c9750 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:49.672243 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b642f169-c334-4594-afad-8b291c5c9750 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.168512 Aug 19 09:18:49.672950 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 149/312] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:49 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:49.758335 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-dcf4a24d-72fd-4dcf-a528-8fdfb0a3fd34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:49.758936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-dcf4a24d-72fd-4dcf-a528-8fdfb0a3fd34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:49.765847 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dcf4a24d-72fd-4dcf-a528-8fdfb0a3fd34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:49.766511 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dcf4a24d-72fd-4dcf-a528-8fdfb0a3fd34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:49.767450 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dcf4a24d-72fd-4dcf-a528-8fdfb0a3fd34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:49.768029 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dcf4a24d-72fd-4dcf-a528-8fdfb0a3fd34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:49.912131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dcf4a24d-72fd-4dcf-a528-8fdfb0a3fd34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:49.922237 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dcf4a24d-72fd-4dcf-a528-8fdfb0a3fd34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:49.924592 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dcf4a24d-72fd-4dcf-a528-8fdfb0a3fd34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:49.926451 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-dcf4a24d-72fd-4dcf-a528-8fdfb0a3fd34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1407 microversion: 2.20 time: 0.171445 Aug 19 09:18:49.927381 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 164/313] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:49 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:50.166054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-30732bd1-08e1-429b-8b1d-935ffde4abff tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:50.167576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-30732bd1-08e1-429b-8b1d-935ffde4abff tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:50.191211 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30732bd1-08e1-429b-8b1d-935ffde4abff tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:50.191323 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30732bd1-08e1-429b-8b1d-935ffde4abff tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:50.192066 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30732bd1-08e1-429b-8b1d-935ffde4abff tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:50.192496 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30732bd1-08e1-429b-8b1d-935ffde4abff tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:50.332363 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-529b3a97-0883-40b8-a908-35f3a51393ad tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:50.336156 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-529b3a97-0883-40b8-a908-35f3a51393ad tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:50.343425 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-529b3a97-0883-40b8-a908-35f3a51393ad tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:50.344082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-529b3a97-0883-40b8-a908-35f3a51393ad tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:50.345561 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-529b3a97-0883-40b8-a908-35f3a51393ad tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:50.347399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-529b3a97-0883-40b8-a908-35f3a51393ad tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:50.400209 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-30732bd1-08e1-429b-8b1d-935ffde4abff tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:50.408478 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-30732bd1-08e1-429b-8b1d-935ffde4abff tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1317 microversion: 2.1 time: 0.246381 Aug 19 09:18:50.409078 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 150/314] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:50 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:50.517923 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-529b3a97-0883-40b8-a908-35f3a51393ad tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:50.525858 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-529b3a97-0883-40b8-a908-35f3a51393ad tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1501 microversion: 2.1 time: 0.197047 Aug 19 09:18:50.527418 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 165/315] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:50 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:50.689978 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ae4830f8-8f40-43eb-9af6-a7f12a94343b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:50.691527 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ae4830f8-8f40-43eb-9af6-a7f12a94343b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:50.698668 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ae4830f8-8f40-43eb-9af6-a7f12a94343b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:50.699111 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ae4830f8-8f40-43eb-9af6-a7f12a94343b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:50.699904 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ae4830f8-8f40-43eb-9af6-a7f12a94343b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:50.700332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ae4830f8-8f40-43eb-9af6-a7f12a94343b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:50.891070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ae4830f8-8f40-43eb-9af6-a7f12a94343b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:50.900972 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ae4830f8-8f40-43eb-9af6-a7f12a94343b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.215290 Aug 19 09:18:50.902326 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 151/316] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:50 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:50.945654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4c2221ed-46b5-46a0-aecd-e50ceda439b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:50.946275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4c2221ed-46b5-46a0-aecd-e50ceda439b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:50.954248 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c2221ed-46b5-46a0-aecd-e50ceda439b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:50.954629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c2221ed-46b5-46a0-aecd-e50ceda439b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:50.965595 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c2221ed-46b5-46a0-aecd-e50ceda439b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:50.966193 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c2221ed-46b5-46a0-aecd-e50ceda439b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:51.133953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4c2221ed-46b5-46a0-aecd-e50ceda439b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:51.142895 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4c2221ed-46b5-46a0-aecd-e50ceda439b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:51.144436 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4c2221ed-46b5-46a0-aecd-e50ceda439b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:51.145576 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4c2221ed-46b5-46a0-aecd-e50ceda439b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1600 microversion: 2.20 time: 0.203572 Aug 19 09:18:51.146858 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 166/317] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:18:50 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1600 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:18:51.165700 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4e335e03-c012-4ce5-8a56-eb335104cf7e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:51.166551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4e335e03-c012-4ce5-8a56-eb335104cf7e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:51.173663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4e335e03-c012-4ce5-8a56-eb335104cf7e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:51.174566 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4e335e03-c012-4ce5-8a56-eb335104cf7e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:51.175451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4e335e03-c012-4ce5-8a56-eb335104cf7e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:51.176048 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4e335e03-c012-4ce5-8a56-eb335104cf7e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:51.335713 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4e335e03-c012-4ce5-8a56-eb335104cf7e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.175554 Aug 19 09:18:51.336563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 152/318] 10.222.0.32 () {60 vars in 1316 bytes} [Thu Aug 19 09:18:51 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:18:51.425406 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d72ee870-d1d8-4187-828f-f2f6fdc93fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:51.426006 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d72ee870-d1d8-4187-828f-f2f6fdc93fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:51.431895 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d72ee870-d1d8-4187-828f-f2f6fdc93fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:51.432653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d72ee870-d1d8-4187-828f-f2f6fdc93fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:51.433570 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d72ee870-d1d8-4187-828f-f2f6fdc93fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:51.434142 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d72ee870-d1d8-4187-828f-f2f6fdc93fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:51.776504 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d72ee870-d1d8-4187-828f-f2f6fdc93fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:51.785153 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d72ee870-d1d8-4187-828f-f2f6fdc93fca tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1507 microversion: 2.1 time: 0.363295 Aug 19 09:18:51.787843 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 167/319] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:51 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:51.921292 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-aa9dbafd-2968-4ae3-a75c-9139ed90e7cd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:51.922206 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-aa9dbafd-2968-4ae3-a75c-9139ed90e7cd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:51.931979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aa9dbafd-2968-4ae3-a75c-9139ed90e7cd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:51.933724 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aa9dbafd-2968-4ae3-a75c-9139ed90e7cd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:51.936459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aa9dbafd-2968-4ae3-a75c-9139ed90e7cd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:51.937073 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aa9dbafd-2968-4ae3-a75c-9139ed90e7cd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:52.192352 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ec75e505-2cb4-4dc5-b49e-88312ac60ace tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ef3bbd4-ff38-4f72-91c0-3a299e7f0eef"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:18:52.193466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ec75e505-2cb4-4dc5-b49e-88312ac60ace tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:52.209560 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec75e505-2cb4-4dc5-b49e-88312ac60ace tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:52.210036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec75e505-2cb4-4dc5-b49e-88312ac60ace tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:52.210941 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec75e505-2cb4-4dc5-b49e-88312ac60ace tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:52.211246 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec75e505-2cb4-4dc5-b49e-88312ac60ace tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:52.259230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-aa9dbafd-2968-4ae3-a75c-9139ed90e7cd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:52.267707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-aa9dbafd-2968-4ae3-a75c-9139ed90e7cd tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.351671 Aug 19 09:18:52.281825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 153/320] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:51 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:52.882569 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ec75e505-2cb4-4dc5-b49e-88312ac60ace tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "POST /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693651 Aug 19 09:18:52.884459 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 168/321] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:18:52 2021] POST /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720/os-volume_attachments => generated 194 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:18:53.269403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1e25a876-f206-46e3-b1fd-05451a273a28 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:18:53.270513 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1e25a876-f206-46e3-b1fd-05451a273a28 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:53.273133 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-3f57904b-8734-4cba-837a-54608dc4cb6e req-dd32b837-d261-410d-83bc-6c1f2c02edbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed06d0a-7ee6-4f00-b470-b19d7331667c", "tag": "137293e7-3590-4eee-8e9a-b01076e25605"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:18:53.275108 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:18:53.275108 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:18:53.278233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e25a876-f206-46e3-b1fd-05451a273a28 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:53.278759 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e25a876-f206-46e3-b1fd-05451a273a28 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:53.279744 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e25a876-f206-46e3-b1fd-05451a273a28 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:53.280364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e25a876-f206-46e3-b1fd-05451a273a28 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:53.296796 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-3f57904b-8734-4cba-837a-54608dc4cb6e req-dd32b837-d261-410d-83bc-6c1f2c02edbc service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:53.297244 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-3f57904b-8734-4cba-837a-54608dc4cb6e req-dd32b837-d261-410d-83bc-6c1f2c02edbc service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:53.342217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-3f57904b-8734-4cba-837a-54608dc4cb6e req-dd32b837-d261-410d-83bc-6c1f2c02edbc service nova] Creating event network-changed:137293e7-3590-4eee-8e9a-b01076e25605 for instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c on hv-cinder-77387 Aug 19 09:18:53.351808 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-3f57904b-8734-4cba-837a-54608dc4cb6e req-dd32b837-d261-410d-83bc-6c1f2c02edbc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081214 Aug 19 09:18:53.353429 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 169/322] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:18:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:18:53.365199 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a5a1fc4a-9be3-45ff-ac1e-be8301bc8445 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:53.366908 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a5a1fc4a-9be3-45ff-ac1e-be8301bc8445 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:53.381464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5a1fc4a-9be3-45ff-ac1e-be8301bc8445 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:53.382129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5a1fc4a-9be3-45ff-ac1e-be8301bc8445 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:53.384369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5a1fc4a-9be3-45ff-ac1e-be8301bc8445 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:53.385016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5a1fc4a-9be3-45ff-ac1e-be8301bc8445 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:53.453841 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1e25a876-f206-46e3-b1fd-05451a273a28 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 14 microversion: 2.20 time: 0.187586 Aug 19 09:18:53.455373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 154/323] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:18:53 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:53.531668 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a5a1fc4a-9be3-45ff-ac1e-be8301bc8445 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:53.542730 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a5a1fc4a-9be3-45ff-ac1e-be8301bc8445 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.185158 Aug 19 09:18:53.543421 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 170/324] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:53 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:54.470911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-fbe13e51-fcfc-4ae2-9ccd-fe8987fecff1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:18:54.472773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-fbe13e51-fcfc-4ae2-9ccd-fe8987fecff1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:54.492590 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9cf152ec-6c7d-4724-a53e-f5686eb909a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5ebad92-1098-4f19-8e0e-ab3a06d386ac"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:18:54.494731 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9cf152ec-6c7d-4724-a53e-f5686eb909a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:54.496638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fbe13e51-fcfc-4ae2-9ccd-fe8987fecff1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:54.497416 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fbe13e51-fcfc-4ae2-9ccd-fe8987fecff1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:54.499405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fbe13e51-fcfc-4ae2-9ccd-fe8987fecff1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:54.500188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fbe13e51-fcfc-4ae2-9ccd-fe8987fecff1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:54.513598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9cf152ec-6c7d-4724-a53e-f5686eb909a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:54.516452 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9cf152ec-6c7d-4724-a53e-f5686eb909a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:54.517587 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9cf152ec-6c7d-4724-a53e-f5686eb909a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:54.518210 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9cf152ec-6c7d-4724-a53e-f5686eb909a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:54.628791 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-fbe13e51-fcfc-4ae2-9ccd-fe8987fecff1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 14 microversion: 2.20 time: 0.165854 Aug 19 09:18:54.629751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 155/325] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:18:54 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:54.637041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0077bcf2-ca10-4018-9bdd-f15554849b38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:54.640814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0077bcf2-ca10-4018-9bdd-f15554849b38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:54.651519 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0077bcf2-ca10-4018-9bdd-f15554849b38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:54.651966 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0077bcf2-ca10-4018-9bdd-f15554849b38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:54.652738 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0077bcf2-ca10-4018-9bdd-f15554849b38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:54.653341 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0077bcf2-ca10-4018-9bdd-f15554849b38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:54.892078 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0077bcf2-ca10-4018-9bdd-f15554849b38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:54.901044 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0077bcf2-ca10-4018-9bdd-f15554849b38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.269018 Aug 19 09:18:54.902204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 156/326] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:54 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:54.919155 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9cf152ec-6c7d-4724-a53e-f5686eb909a2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "POST /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432847 Aug 19 09:18:54.925342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 171/327] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:18:54 2021] POST /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:18:55.640405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-00dc19a5-c748-48bf-b804-939eb3864f6b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:18:55.641315 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-00dc19a5-c748-48bf-b804-939eb3864f6b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:55.647758 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00dc19a5-c748-48bf-b804-939eb3864f6b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:55.648389 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00dc19a5-c748-48bf-b804-939eb3864f6b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:55.649439 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00dc19a5-c748-48bf-b804-939eb3864f6b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:55.650525 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00dc19a5-c748-48bf-b804-939eb3864f6b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:55.924146 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-49f8700b-b6e8-48b5-9907-2dc83e296765 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:55.925616 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-49f8700b-b6e8-48b5-9907-2dc83e296765 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:55.933178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-49f8700b-b6e8-48b5-9907-2dc83e296765 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:55.933627 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-49f8700b-b6e8-48b5-9907-2dc83e296765 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:55.935002 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-49f8700b-b6e8-48b5-9907-2dc83e296765 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:55.935002 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-49f8700b-b6e8-48b5-9907-2dc83e296765 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:56.094448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-49f8700b-b6e8-48b5-9907-2dc83e296765 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:56.102589 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-49f8700b-b6e8-48b5-9907-2dc83e296765 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.186979 Aug 19 09:18:56.103074 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 172/328] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:55 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:57.119650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6fa84d63-e1e1-4ea9-8029-88eef473c140 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:57.120272 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6fa84d63-e1e1-4ea9-8029-88eef473c140 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:57.127463 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6fa84d63-e1e1-4ea9-8029-88eef473c140 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:57.128033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6fa84d63-e1e1-4ea9-8029-88eef473c140 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:57.128803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6fa84d63-e1e1-4ea9-8029-88eef473c140 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:57.129256 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6fa84d63-e1e1-4ea9-8029-88eef473c140 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:57.278336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6fa84d63-e1e1-4ea9-8029-88eef473c140 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:57.287155 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6fa84d63-e1e1-4ea9-8029-88eef473c140 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.170748 Aug 19 09:18:57.287811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 173/329] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:57 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:58.304757 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-70d9172f-46fd-4057-b439-4bd073fed330 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:58.305338 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-70d9172f-46fd-4057-b439-4bd073fed330 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:58.320820 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70d9172f-46fd-4057-b439-4bd073fed330 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:58.321543 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70d9172f-46fd-4057-b439-4bd073fed330 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:58.322759 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70d9172f-46fd-4057-b439-4bd073fed330 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:58.323511 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70d9172f-46fd-4057-b439-4bd073fed330 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:58.477142 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-70d9172f-46fd-4057-b439-4bd073fed330 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:58.485852 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-70d9172f-46fd-4057-b439-4bd073fed330 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.184800 Aug 19 09:18:58.486416 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 174/330] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:58 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:18:59.093854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-00dc19a5-c748-48bf-b804-939eb3864f6b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 14 microversion: 2.20 time: 3.457145 Aug 19 09:18:59.095034 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 157/331] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:18:55 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 14 bytes in 3459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:18:59.503183 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-35b04fe0-5f1a-47fe-aaa9-ce51641a54eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:18:59.504386 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-35b04fe0-5f1a-47fe-aaa9-ce51641a54eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:18:59.510671 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35b04fe0-5f1a-47fe-aaa9-ce51641a54eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:59.511127 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35b04fe0-5f1a-47fe-aaa9-ce51641a54eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:59.511932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35b04fe0-5f1a-47fe-aaa9-ce51641a54eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:18:59.512396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35b04fe0-5f1a-47fe-aaa9-ce51641a54eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:18:59.633088 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-35b04fe0-5f1a-47fe-aaa9-ce51641a54eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:18:59.641216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-35b04fe0-5f1a-47fe-aaa9-ce51641a54eb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.141919 Aug 19 09:18:59.641774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 175/332] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:18:59 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:00.105551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3654f9d9-443c-4b86-a63a-9518c16a4a8b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:00.106592 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3654f9d9-443c-4b86-a63a-9518c16a4a8b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:00.114569 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3654f9d9-443c-4b86-a63a-9518c16a4a8b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:00.115015 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3654f9d9-443c-4b86-a63a-9518c16a4a8b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:00.116036 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3654f9d9-443c-4b86-a63a-9518c16a4a8b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:00.116466 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3654f9d9-443c-4b86-a63a-9518c16a4a8b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:00.220034 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3654f9d9-443c-4b86-a63a-9518c16a4a8b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 14 microversion: 2.20 time: 0.118395 Aug 19 09:19:00.220706 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 158/333] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:00 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:00.657472 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d59632c0-0f51-4ca7-8eae-9a6869d6952c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:00.658079 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d59632c0-0f51-4ca7-8eae-9a6869d6952c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:00.664748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d59632c0-0f51-4ca7-8eae-9a6869d6952c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:00.665195 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d59632c0-0f51-4ca7-8eae-9a6869d6952c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:00.665971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d59632c0-0f51-4ca7-8eae-9a6869d6952c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:00.666448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d59632c0-0f51-4ca7-8eae-9a6869d6952c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:00.789596 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d59632c0-0f51-4ca7-8eae-9a6869d6952c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:00.797482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d59632c0-0f51-4ca7-8eae-9a6869d6952c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.143578 Aug 19 09:19:00.798020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 176/334] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:00 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:01.232332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5f5503bf-1fb4-4502-86d9-2f8514f99b5e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:01.233690 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5f5503bf-1fb4-4502-86d9-2f8514f99b5e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:01.242078 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f5503bf-1fb4-4502-86d9-2f8514f99b5e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:01.242232 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f5503bf-1fb4-4502-86d9-2f8514f99b5e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:01.243014 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f5503bf-1fb4-4502-86d9-2f8514f99b5e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:01.243481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f5503bf-1fb4-4502-86d9-2f8514f99b5e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:01.345703 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5f5503bf-1fb4-4502-86d9-2f8514f99b5e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 14 microversion: 2.20 time: 0.117332 Aug 19 09:19:01.346441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 159/335] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:01 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:01.817640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-61e0bdc7-7f66-49c1-b819-da0c1b2eecd2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:01.818569 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-61e0bdc7-7f66-49c1-b819-da0c1b2eecd2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:01.825081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61e0bdc7-7f66-49c1-b819-da0c1b2eecd2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:01.825598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61e0bdc7-7f66-49c1-b819-da0c1b2eecd2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:01.826515 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61e0bdc7-7f66-49c1-b819-da0c1b2eecd2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:01.826945 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61e0bdc7-7f66-49c1-b819-da0c1b2eecd2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:01.958592 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-61e0bdc7-7f66-49c1-b819-da0c1b2eecd2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:01.967236 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-61e0bdc7-7f66-49c1-b819-da0c1b2eecd2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.156757 Aug 19 09:19:01.967926 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 177/336] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:01 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:02.358116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-56f793e6-84d2-4ee1-973a-884465c810ae tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:02.359295 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-56f793e6-84d2-4ee1-973a-884465c810ae tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:02.365840 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-56f793e6-84d2-4ee1-973a-884465c810ae tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:02.366284 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-56f793e6-84d2-4ee1-973a-884465c810ae tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:02.367047 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-56f793e6-84d2-4ee1-973a-884465c810ae tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:02.367518 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-56f793e6-84d2-4ee1-973a-884465c810ae tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:02.491629 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-56f793e6-84d2-4ee1-973a-884465c810ae tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 14 microversion: 2.20 time: 0.137983 Aug 19 09:19:02.494789 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 160/337] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:02 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:02.985153 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a2acc472-c071-492e-ba3f-5f027f1dad3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:02.986058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a2acc472-c071-492e-ba3f-5f027f1dad3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:02.992921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2acc472-c071-492e-ba3f-5f027f1dad3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:02.993522 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2acc472-c071-492e-ba3f-5f027f1dad3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:02.994386 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2acc472-c071-492e-ba3f-5f027f1dad3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:02.994862 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2acc472-c071-492e-ba3f-5f027f1dad3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:03.124407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a2acc472-c071-492e-ba3f-5f027f1dad3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:03.134176 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a2acc472-c071-492e-ba3f-5f027f1dad3c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.153101 Aug 19 09:19:03.135040 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 178/338] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:02 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:03.503021 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7f3b77ec-4b46-412f-b8d1-b422cf153949 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:03.504053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7f3b77ec-4b46-412f-b8d1-b422cf153949 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:03.511851 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f3b77ec-4b46-412f-b8d1-b422cf153949 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:03.512386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f3b77ec-4b46-412f-b8d1-b422cf153949 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:03.513163 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f3b77ec-4b46-412f-b8d1-b422cf153949 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:03.513648 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f3b77ec-4b46-412f-b8d1-b422cf153949 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:03.646088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7f3b77ec-4b46-412f-b8d1-b422cf153949 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 14 microversion: 2.20 time: 0.147526 Aug 19 09:19:03.646807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 161/339] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:03 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:04.152640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b75ff1f7-44b7-41b7-bf65-a65f03e59eda tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:04.153260 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b75ff1f7-44b7-41b7-bf65-a65f03e59eda tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:04.161101 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b75ff1f7-44b7-41b7-bf65-a65f03e59eda tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:04.161438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b75ff1f7-44b7-41b7-bf65-a65f03e59eda tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:04.162141 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b75ff1f7-44b7-41b7-bf65-a65f03e59eda tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:04.163042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b75ff1f7-44b7-41b7-bf65-a65f03e59eda tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:04.345356 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b75ff1f7-44b7-41b7-bf65-a65f03e59eda tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:04.352863 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b75ff1f7-44b7-41b7-bf65-a65f03e59eda tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.204638 Aug 19 09:19:04.353684 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 179/340] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:04 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:04.666422 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a5c132ac-2431-472d-9956-ec6a2b9e170f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:04.667430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a5c132ac-2431-472d-9956-ec6a2b9e170f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:04.675009 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a5c132ac-2431-472d-9956-ec6a2b9e170f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:04.675487 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a5c132ac-2431-472d-9956-ec6a2b9e170f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:04.676250 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a5c132ac-2431-472d-9956-ec6a2b9e170f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:04.676685 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a5c132ac-2431-472d-9956-ec6a2b9e170f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:04.830368 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a5c132ac-2431-472d-9956-ec6a2b9e170f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 14 microversion: 2.20 time: 0.168309 Aug 19 09:19:04.831050 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 162/341] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:04 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:05.369710 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e28e2c95-bb6b-4714-af7a-f1adc6205513 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:05.370298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e28e2c95-bb6b-4714-af7a-f1adc6205513 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:05.376737 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e28e2c95-bb6b-4714-af7a-f1adc6205513 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:05.377177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e28e2c95-bb6b-4714-af7a-f1adc6205513 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:05.377936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e28e2c95-bb6b-4714-af7a-f1adc6205513 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:05.378369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e28e2c95-bb6b-4714-af7a-f1adc6205513 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:05.507208 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e28e2c95-bb6b-4714-af7a-f1adc6205513 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:05.516404 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e28e2c95-bb6b-4714-af7a-f1adc6205513 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.149939 Aug 19 09:19:05.517020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 180/342] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:05 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:05.842907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8c1c271f-4c8b-4d9d-9815-15ce4375ea15 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:05.844098 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8c1c271f-4c8b-4d9d-9815-15ce4375ea15 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:05.851125 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8c1c271f-4c8b-4d9d-9815-15ce4375ea15 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:05.851818 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8c1c271f-4c8b-4d9d-9815-15ce4375ea15 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:05.852627 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8c1c271f-4c8b-4d9d-9815-15ce4375ea15 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:05.853144 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8c1c271f-4c8b-4d9d-9815-15ce4375ea15 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:06.024032 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8c1c271f-4c8b-4d9d-9815-15ce4375ea15 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 14 microversion: 2.20 time: 0.185758 Aug 19 09:19:06.024660 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 163/343] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:05 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:06.533022 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3866f2a7-56ac-42d3-bb00-db666e3c7f60 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:06.533629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3866f2a7-56ac-42d3-bb00-db666e3c7f60 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:06.539634 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3866f2a7-56ac-42d3-bb00-db666e3c7f60 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:06.540089 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3866f2a7-56ac-42d3-bb00-db666e3c7f60 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:06.540858 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3866f2a7-56ac-42d3-bb00-db666e3c7f60 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:06.541290 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3866f2a7-56ac-42d3-bb00-db666e3c7f60 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:06.706983 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3866f2a7-56ac-42d3-bb00-db666e3c7f60 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:06.714940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3866f2a7-56ac-42d3-bb00-db666e3c7f60 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.185560 Aug 19 09:19:06.717880 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 181/344] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:06 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:07.035582 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d05fde99-045c-46c9-bd97-9d0401537764 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:07.036573 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d05fde99-045c-46c9-bd97-9d0401537764 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:07.046778 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d05fde99-045c-46c9-bd97-9d0401537764 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:07.047434 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d05fde99-045c-46c9-bd97-9d0401537764 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:07.048641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d05fde99-045c-46c9-bd97-9d0401537764 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:07.049638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d05fde99-045c-46c9-bd97-9d0401537764 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:07.246226 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d05fde99-045c-46c9-bd97-9d0401537764 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 14 microversion: 2.20 time: 0.214313 Aug 19 09:19:07.246729 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 164/345] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:07 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:07.781141 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6cbcd035-92e0-4b43-a3c6-dfe8f6a48334 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:07.781746 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6cbcd035-92e0-4b43-a3c6-dfe8f6a48334 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:07.787608 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cbcd035-92e0-4b43-a3c6-dfe8f6a48334 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:07.788080 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cbcd035-92e0-4b43-a3c6-dfe8f6a48334 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:07.788848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cbcd035-92e0-4b43-a3c6-dfe8f6a48334 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:07.789280 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cbcd035-92e0-4b43-a3c6-dfe8f6a48334 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:07.941119 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6cbcd035-92e0-4b43-a3c6-dfe8f6a48334 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:07.950123 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6cbcd035-92e0-4b43-a3c6-dfe8f6a48334 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.172636 Aug 19 09:19:07.952083 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 182/346] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:07 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:08.257879 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-faeab0c9-c7cb-4828-a3e5-b95a960d7461 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:08.258867 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-faeab0c9-c7cb-4828-a3e5-b95a960d7461 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:08.266601 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-faeab0c9-c7cb-4828-a3e5-b95a960d7461 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:08.267055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-faeab0c9-c7cb-4828-a3e5-b95a960d7461 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:08.267852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-faeab0c9-c7cb-4828-a3e5-b95a960d7461 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:08.268287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-faeab0c9-c7cb-4828-a3e5-b95a960d7461 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:08.403197 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-faeab0c9-c7cb-4828-a3e5-b95a960d7461 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 4648 microversion: 2.20 time: 0.149085 Aug 19 09:19:08.406780 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 165/347] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:08 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 4648 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:19:08.968676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e5cfbf98-aaa4-479a-aa2d-0cac653a52d6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:08.969285 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e5cfbf98-aaa4-479a-aa2d-0cac653a52d6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:08.975315 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e5cfbf98-aaa4-479a-aa2d-0cac653a52d6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:08.975706 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e5cfbf98-aaa4-479a-aa2d-0cac653a52d6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:08.976481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e5cfbf98-aaa4-479a-aa2d-0cac653a52d6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:08.976915 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e5cfbf98-aaa4-479a-aa2d-0cac653a52d6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:09.156652 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a67b77c4-4025-4a83-88ff-e28102c501b2 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:09.157393 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a67b77c4-4025-4a83-88ff-e28102c501b2 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:09.163490 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e5cfbf98-aaa4-479a-aa2d-0cac653a52d6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:09.171867 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e5cfbf98-aaa4-479a-aa2d-0cac653a52d6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.207034 Aug 19 09:19:09.172434 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 183/348] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:08 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:09.176639 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a67b77c4-4025-4a83-88ff-e28102c501b2 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:09.178215 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a67b77c4-4025-4a83-88ff-e28102c501b2 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:09.180162 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a67b77c4-4025-4a83-88ff-e28102c501b2 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:09.183887 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a67b77c4-4025-4a83-88ff-e28102c501b2 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:09.216853 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a67b77c4-4025-4a83-88ff-e28102c501b2 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:19:09.359092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a67b77c4-4025-4a83-88ff-e28102c501b2 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 204 len: 0 microversion: 2.1 time: 0.206559 Aug 19 09:19:09.360014 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 166/349] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:19:09 2021] DELETE /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 09:19:09.368255 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d862d1df-0ed8-4070-a49c-9f43efff2187 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:09.369319 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d862d1df-0ed8-4070-a49c-9f43efff2187 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:09.375601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d862d1df-0ed8-4070-a49c-9f43efff2187 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:09.376258 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d862d1df-0ed8-4070-a49c-9f43efff2187 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:09.377468 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d862d1df-0ed8-4070-a49c-9f43efff2187 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:09.378034 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d862d1df-0ed8-4070-a49c-9f43efff2187 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:09.419419 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d5cf231e-c952-44f0-aa65-7d96d7ad3f2e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:09.421106 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d5cf231e-c952-44f0-aa65-7d96d7ad3f2e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:09.427210 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5cf231e-c952-44f0-aa65-7d96d7ad3f2e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:09.427693 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5cf231e-c952-44f0-aa65-7d96d7ad3f2e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:09.428525 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5cf231e-c952-44f0-aa65-7d96d7ad3f2e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:09.428964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5cf231e-c952-44f0-aa65-7d96d7ad3f2e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:09.576060 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d862d1df-0ed8-4070-a49c-9f43efff2187 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:09.585035 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d5cf231e-c952-44f0-aa65-7d96d7ad3f2e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 8562 microversion: 2.20 time: 0.174038 Aug 19 09:19:09.585454 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d862d1df-0ed8-4070-a49c-9f43efff2187 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1553 microversion: 2.1 time: 0.221239 Aug 19 09:19:09.586181 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 184/351] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:09 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:09.586297 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 167/351] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:09 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 8562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:19:10.195205 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2b44ade0-c8c7-46da-87b7-62d56e87333f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:10.196165 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2b44ade0-c8c7-46da-87b7-62d56e87333f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:10.203692 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2b44ade0-c8c7-46da-87b7-62d56e87333f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:10.204138 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2b44ade0-c8c7-46da-87b7-62d56e87333f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:10.204907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2b44ade0-c8c7-46da-87b7-62d56e87333f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:10.205373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2b44ade0-c8c7-46da-87b7-62d56e87333f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:10.365438 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2b44ade0-c8c7-46da-87b7-62d56e87333f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:10.382376 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2b44ade0-c8c7-46da-87b7-62d56e87333f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.191741 Aug 19 09:19:10.383430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 168/352] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:10 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:10.599434 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-da1ad99c-8e3e-4de5-8334-48120d5b9997 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:10.600446 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-da1ad99c-8e3e-4de5-8334-48120d5b9997 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:10.605445 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-26e47a67-0123-4ee6-8afb-c31f792bc736 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:10.606062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-26e47a67-0123-4ee6-8afb-c31f792bc736 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:10.606360 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da1ad99c-8e3e-4de5-8334-48120d5b9997 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:10.606807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da1ad99c-8e3e-4de5-8334-48120d5b9997 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:10.608221 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da1ad99c-8e3e-4de5-8334-48120d5b9997 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:10.608645 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da1ad99c-8e3e-4de5-8334-48120d5b9997 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:10.612911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-26e47a67-0123-4ee6-8afb-c31f792bc736 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:10.613358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-26e47a67-0123-4ee6-8afb-c31f792bc736 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:10.614306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-26e47a67-0123-4ee6-8afb-c31f792bc736 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:10.614742 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-26e47a67-0123-4ee6-8afb-c31f792bc736 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:10.723821 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-da1ad99c-8e3e-4de5-8334-48120d5b9997 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 12936 microversion: 2.20 time: 0.129934 Aug 19 09:19:10.724645 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 185/353] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:10 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 12936 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:10.746002 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-26e47a67-0123-4ee6-8afb-c31f792bc736 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:10.755195 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-26e47a67-0123-4ee6-8afb-c31f792bc736 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1553 microversion: 2.1 time: 0.154187 Aug 19 09:19:10.755880 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 169/354] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:10 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:11.402663 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2690bc65-df30-4b0e-9cc6-9c74625c7ea6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:11.403748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2690bc65-df30-4b0e-9cc6-9c74625c7ea6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:11.410836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2690bc65-df30-4b0e-9cc6-9c74625c7ea6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:11.411310 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2690bc65-df30-4b0e-9cc6-9c74625c7ea6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:11.413434 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2690bc65-df30-4b0e-9cc6-9c74625c7ea6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:11.413874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2690bc65-df30-4b0e-9cc6-9c74625c7ea6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:11.539909 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2690bc65-df30-4b0e-9cc6-9c74625c7ea6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:11.547680 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2690bc65-df30-4b0e-9cc6-9c74625c7ea6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.151356 Aug 19 09:19:11.548241 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 186/355] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:11 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:11.735660 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3cb0b659-5399-41cb-9887-0bcaf878cc61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:11.736557 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3cb0b659-5399-41cb-9887-0bcaf878cc61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:11.742819 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cb0b659-5399-41cb-9887-0bcaf878cc61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:11.743262 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cb0b659-5399-41cb-9887-0bcaf878cc61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:11.744048 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cb0b659-5399-41cb-9887-0bcaf878cc61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:11.744480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cb0b659-5399-41cb-9887-0bcaf878cc61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:11.772635 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0b2a6889-5810-4a15-af7e-caff2846cf26 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:11.773181 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0b2a6889-5810-4a15-af7e-caff2846cf26 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:11.778984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b2a6889-5810-4a15-af7e-caff2846cf26 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:11.779519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b2a6889-5810-4a15-af7e-caff2846cf26 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:11.780717 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b2a6889-5810-4a15-af7e-caff2846cf26 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:11.781128 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b2a6889-5810-4a15-af7e-caff2846cf26 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:11.908192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0b2a6889-5810-4a15-af7e-caff2846cf26 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:11.912370 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3cb0b659-5399-41cb-9887-0bcaf878cc61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 15782 microversion: 2.20 time: 0.180501 Aug 19 09:19:11.913373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 170/356] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:11 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 15782 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:11.917387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0b2a6889-5810-4a15-af7e-caff2846cf26 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1553 microversion: 2.1 time: 0.148954 Aug 19 09:19:11.918040 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 187/357] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:11 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:12.565445 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4a48eedd-3f0d-4b47-b5bd-7fdb196d1ccb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:12.566068 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4a48eedd-3f0d-4b47-b5bd-7fdb196d1ccb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:12.572334 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a48eedd-3f0d-4b47-b5bd-7fdb196d1ccb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:12.572770 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a48eedd-3f0d-4b47-b5bd-7fdb196d1ccb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:12.573521 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a48eedd-3f0d-4b47-b5bd-7fdb196d1ccb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:12.573949 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a48eedd-3f0d-4b47-b5bd-7fdb196d1ccb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:12.708593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4a48eedd-3f0d-4b47-b5bd-7fdb196d1ccb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:12.715698 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4a48eedd-3f0d-4b47-b5bd-7fdb196d1ccb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.154272 Aug 19 09:19:12.716255 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 171/358] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:12 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:12.756388 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1645447547", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "networks": [{"uuid": "91d9aee0-6921-4c01-95c7-a746e497353e"}]}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:12.924442 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-759a929c-f4bc-4bb3-8a1b-03157515f336 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:12.925405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-759a929c-f4bc-4bb3-8a1b-03157515f336 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:12.931447 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-759a929c-f4bc-4bb3-8a1b-03157515f336 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:12.931893 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-759a929c-f4bc-4bb3-8a1b-03157515f336 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:12.932645 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-759a929c-f4bc-4bb3-8a1b-03157515f336 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:12.933073 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-759a929c-f4bc-4bb3-8a1b-03157515f336 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:13.133414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-759a929c-f4bc-4bb3-8a1b-03157515f336 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 17659 microversion: 2.20 time: 0.212377 Aug 19 09:19:13.137041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 172/359] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:12 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 17659 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:13.139087 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-babedc42-efbe-41c6-9780-6b6ff8ab3360 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:13.140123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-babedc42-efbe-41c6-9780-6b6ff8ab3360 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:13.148957 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-babedc42-efbe-41c6-9780-6b6ff8ab3360 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:13.149635 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-babedc42-efbe-41c6-9780-6b6ff8ab3360 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:13.150886 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-babedc42-efbe-41c6-9780-6b6ff8ab3360 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:13.151608 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-babedc42-efbe-41c6-9780-6b6ff8ab3360 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:13.396609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-babedc42-efbe-41c6-9780-6b6ff8ab3360 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:13.405865 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-babedc42-efbe-41c6-9780-6b6ff8ab3360 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1553 microversion: 2.1 time: 0.270236 Aug 19 09:19:13.406483 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 173/360] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:13 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:13.732715 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e6f406ce-08fc-4317-9d5c-b2e3e1564d54 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:13.733312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e6f406ce-08fc-4317-9d5c-b2e3e1564d54 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:13.742264 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e6f406ce-08fc-4317-9d5c-b2e3e1564d54 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:13.743438 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e6f406ce-08fc-4317-9d5c-b2e3e1564d54 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:13.744380 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e6f406ce-08fc-4317-9d5c-b2e3e1564d54 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:13.744963 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e6f406ce-08fc-4317-9d5c-b2e3e1564d54 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:13.996444 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e6f406ce-08fc-4317-9d5c-b2e3e1564d54 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:14.004346 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e6f406ce-08fc-4317-9d5c-b2e3e1564d54 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.275580 Aug 19 09:19:14.005071 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 174/361] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:13 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:14.009379 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-00cb0ce3-ede5-43db-adfc-fcbfb8001be6 req-78a15efc-eca5-4c04-bda7-d8e5da02ed4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d8a445-b5d9-4394-955e-6b57dda71720", "name": "network-vif-deleted", "tag": "fe32dc17-332d-4b18-91b9-52ea978ffebd"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:14.011033 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:19:14.011033 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:19:14.020169 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-00cb0ce3-ede5-43db-adfc-fcbfb8001be6 req-78a15efc-eca5-4c04-bda7-d8e5da02ed4a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:14.022340 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-00cb0ce3-ede5-43db-adfc-fcbfb8001be6 req-78a15efc-eca5-4c04-bda7-d8e5da02ed4a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:14.033621 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-00cb0ce3-ede5-43db-adfc-fcbfb8001be6 req-78a15efc-eca5-4c04-bda7-d8e5da02ed4a service nova] Creating event network-vif-deleted:fe32dc17-332d-4b18-91b9-52ea978ffebd for instance e7d8a445-b5d9-4394-955e-6b57dda71720 on hv-cinder-77387 Aug 19 09:19:14.038349 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-00cb0ce3-ede5-43db-adfc-fcbfb8001be6 req-78a15efc-eca5-4c04-bda7-d8e5da02ed4a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032106 Aug 19 09:19:14.038929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 175/362] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:19:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:14.146290 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b3757790-6b78-464d-8ebb-3a70dc2ea252 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:14.147333 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b3757790-6b78-464d-8ebb-3a70dc2ea252 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:14.153317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b3757790-6b78-464d-8ebb-3a70dc2ea252 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:14.153762 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b3757790-6b78-464d-8ebb-3a70dc2ea252 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:14.154754 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b3757790-6b78-464d-8ebb-3a70dc2ea252 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:14.155188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b3757790-6b78-464d-8ebb-3a70dc2ea252 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:14.266055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b3757790-6b78-464d-8ebb-3a70dc2ea252 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 17744 microversion: 2.20 time: 0.123991 Aug 19 09:19:14.266672 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 176/363] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:14 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 17744 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:14.423318 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4caf6752-7bec-4d54-9891-81f059cc7140 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:14.424024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4caf6752-7bec-4d54-9891-81f059cc7140 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:14.430357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4caf6752-7bec-4d54-9891-81f059cc7140 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:14.430803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4caf6752-7bec-4d54-9891-81f059cc7140 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:14.431597 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4caf6752-7bec-4d54-9891-81f059cc7140 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:14.432038 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4caf6752-7bec-4d54-9891-81f059cc7140 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:14.494104 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4caf6752-7bec-4d54-9891-81f059cc7140 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:14.503301 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4caf6752-7bec-4d54-9891-81f059cc7140 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1346 microversion: 2.1 time: 0.085033 Aug 19 09:19:14.503855 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 177/364] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:14 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:15.022799 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-99799ee7-3ca3-4179-bd5b-b4c2b09d0656 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:15.023698 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-99799ee7-3ca3-4179-bd5b-b4c2b09d0656 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:15.030207 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99799ee7-3ca3-4179-bd5b-b4c2b09d0656 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:15.030649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99799ee7-3ca3-4179-bd5b-b4c2b09d0656 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:15.031432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99799ee7-3ca3-4179-bd5b-b4c2b09d0656 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:15.031861 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99799ee7-3ca3-4179-bd5b-b4c2b09d0656 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:15.150902 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-99799ee7-3ca3-4179-bd5b-b4c2b09d0656 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:15.158999 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-99799ee7-3ca3-4179-bd5b-b4c2b09d0656 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.140701 Aug 19 09:19:15.159588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 178/365] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:15 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:15.277995 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a78a667c-1a32-405c-96c0-73953950707b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:15.279085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a78a667c-1a32-405c-96c0-73953950707b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:15.285459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a78a667c-1a32-405c-96c0-73953950707b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:15.285913 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a78a667c-1a32-405c-96c0-73953950707b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:15.286882 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a78a667c-1a32-405c-96c0-73953950707b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:15.287369 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a78a667c-1a32-405c-96c0-73953950707b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:15.399730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a78a667c-1a32-405c-96c0-73953950707b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 19342 microversion: 2.20 time: 0.126117 Aug 19 09:19:15.400386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 179/366] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:15 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 19342 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:15.520789 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-00a8ba2c-ea87-4153-8fe0-caf9bbfc8c76 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:15.521501 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-00a8ba2c-ea87-4153-8fe0-caf9bbfc8c76 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:15.527881 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00a8ba2c-ea87-4153-8fe0-caf9bbfc8c76 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:15.528326 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00a8ba2c-ea87-4153-8fe0-caf9bbfc8c76 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:15.529192 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00a8ba2c-ea87-4153-8fe0-caf9bbfc8c76 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:15.529803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00a8ba2c-ea87-4153-8fe0-caf9bbfc8c76 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:15.593588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-00a8ba2c-ea87-4153-8fe0-caf9bbfc8c76 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c4dff902b4c8aa26d9b1e58bd4e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a1a9a34bd848cd8c97172208bd43ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:15.602062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-00a8ba2c-ea87-4153-8fe0-caf9bbfc8c76 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 200 len: 1346 microversion: 2.1 time: 0.085209 Aug 19 09:19:15.602736 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 180/367] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:15 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:16.176298 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f47dc199-7718-4369-bc95-ef1edf568007 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:16.177053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f47dc199-7718-4369-bc95-ef1edf568007 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:16.182935 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f47dc199-7718-4369-bc95-ef1edf568007 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:16.183422 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f47dc199-7718-4369-bc95-ef1edf568007 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:16.184190 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f47dc199-7718-4369-bc95-ef1edf568007 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:16.184624 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f47dc199-7718-4369-bc95-ef1edf568007 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:16.346857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f47dc199-7718-4369-bc95-ef1edf568007 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:16.356474 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f47dc199-7718-4369-bc95-ef1edf568007 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.183732 Aug 19 09:19:16.357903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 181/368] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:16 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:16.412807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b34f64f0-d203-40e3-a42d-a55e0f3e5ddf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:16.425318 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b34f64f0-d203-40e3-a42d-a55e0f3e5ddf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:16.431195 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b34f64f0-d203-40e3-a42d-a55e0f3e5ddf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:16.431673 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b34f64f0-d203-40e3-a42d-a55e0f3e5ddf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:16.432622 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b34f64f0-d203-40e3-a42d-a55e0f3e5ddf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:16.433451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b34f64f0-d203-40e3-a42d-a55e0f3e5ddf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:16.555445 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b34f64f0-d203-40e3-a42d-a55e0f3e5ddf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 20991 microversion: 2.20 time: 0.148332 Aug 19 09:19:16.556093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 182/369] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:16 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 20991 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:16.613872 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2006980576", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "networks": [{"uuid": "5e78b5e6-6e38-4b51-a3a6-7fec0d074363"}]}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:26.771043 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.network.neutron [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] validate_networks() for [('91d9aee0-6921-4c01-95c7-a746e497353e', None, None, None, None, None)] {{(pid=107957) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:19:26.777275 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] validate_networks() for [('5e78b5e6-6e38-4b51-a3a6-7fec0d074363', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:19:27.162550 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:19:27.162974 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:19:27.163484 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:19:27.163895 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:19:27.164306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:19:27.173436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.173983 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.174849 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.175381 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.191458 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Getting quotas for project 8bd62739089241319075c92d0306a0a3. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:19:27.195341 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Getting quotas for user bfa387ffa6784561956f39df611dfab4 and project 8bd62739089241319075c92d0306a0a3. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:19:27.207571 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:19:27.210073 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:19:27.257392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-31439bbc-192c-470d-b80e-f1a753d66189 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.647510 Aug 19 09:19:27.258027 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 183/370] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:19:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 10649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 09:19:27.262353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-28a65685-2204-4c31-8df6-337eb98c28e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:27.263427 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-28a65685-2204-4c31-8df6-337eb98c28e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:27.270129 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-28a65685-2204-4c31-8df6-337eb98c28e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.270568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-28a65685-2204-4c31-8df6-337eb98c28e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.273204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-28a65685-2204-4c31-8df6-337eb98c28e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.273647 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-28a65685-2204-4c31-8df6-337eb98c28e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.292899 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-28a65685-2204-4c31-8df6-337eb98c28e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] HTTP exception thrown: Instance e7d8a445-b5d9-4394-955e-6b57dda71720 could not be found. Aug 19 09:19:27.293485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-28a65685-2204-4c31-8df6-337eb98c28e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Returning 404 to user: Instance e7d8a445-b5d9-4394-955e-6b57dda71720 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:19:27.294306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-28a65685-2204-4c31-8df6-337eb98c28e1 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 404 len: 111 microversion: 2.1 time: 0.035396 Aug 19 09:19:27.298101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 184/371] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:27 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:19:27.299690 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5f8b5991-8f76-4b1b-88b8-04bb9779f694 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:27.300342 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5f8b5991-8f76-4b1b-88b8-04bb9779f694 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:27.306155 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f8b5991-8f76-4b1b-88b8-04bb9779f694 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.306738 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f8b5991-8f76-4b1b-88b8-04bb9779f694 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.307436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f8b5991-8f76-4b1b-88b8-04bb9779f694 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.307866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f8b5991-8f76-4b1b-88b8-04bb9779f694 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.354187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Flavor limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:19:27.354792 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Image limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:19:27.355857 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Flavor pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:19:27.359905 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Image pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:19:27.360777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:19:27.387844 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.388298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.389105 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.389652 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.419222 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Getting quotas for project ca3fe8da8a104ba2b3e206211030cffb. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:19:27.423596 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Getting quotas for user 0ea096a506eb45af9559d4ccc9698673 and project ca3fe8da8a104ba2b3e206211030cffb. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:19:27.435235 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Going to run 1 instances... {{(pid=107957) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:19:27.437862 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:19:27.457972 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5f8b5991-8f76-4b1b-88b8-04bb9779f694 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:27.466938 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5f8b5991-8f76-4b1b-88b8-04bb9779f694 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.170808 Aug 19 09:19:27.476981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 185/372] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:27 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:27.488699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-86b57d04-7c9b-45c0-a068-8a82810305cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:27.490387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-86b57d04-7c9b-45c0-a068-8a82810305cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:27.497673 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-86b57d04-7c9b-45c0-a068-8a82810305cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.498408 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-86b57d04-7c9b-45c0-a068-8a82810305cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.499493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-86b57d04-7c9b-45c0-a068-8a82810305cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.499929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-86b57d04-7c9b-45c0-a068-8a82810305cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.508367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-104f782e-06a7-4a4a-8f8e-59a8cf64eb65 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.755499 Aug 19 09:19:27.509071 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 188/373] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:19:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 14757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:19:27.513325 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-62e00a8a-d039-4306-af6e-f9f94cbed62b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:27.513992 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-62e00a8a-d039-4306-af6e-f9f94cbed62b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:27.573975 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-62e00a8a-d039-4306-af6e-f9f94cbed62b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:27.582132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-62e00a8a-d039-4306-af6e-f9f94cbed62b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1218 microversion: 2.1 time: 0.072083 Aug 19 09:19:27.582676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 189/374] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:27 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:27.587014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-eaef6fa7-1322-4785-8a5c-eff6d47a3f1f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:27.588005 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-eaef6fa7-1322-4785-8a5c-eff6d47a3f1f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:27.593735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eaef6fa7-1322-4785-8a5c-eff6d47a3f1f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.594261 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eaef6fa7-1322-4785-8a5c-eff6d47a3f1f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.595232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eaef6fa7-1322-4785-8a5c-eff6d47a3f1f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:27.595816 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eaef6fa7-1322-4785-8a5c-eff6d47a3f1f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:27.611684 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-eaef6fa7-1322-4785-8a5c-eff6d47a3f1f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] HTTP exception thrown: Instance e7d8a445-b5d9-4394-955e-6b57dda71720 could not be found. Aug 19 09:19:27.612341 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-eaef6fa7-1322-4785-8a5c-eff6d47a3f1f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Returning 404 to user: Instance e7d8a445-b5d9-4394-955e-6b57dda71720 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:19:27.613239 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-eaef6fa7-1322-4785-8a5c-eff6d47a3f1f tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029602 Aug 19 09:19:27.613842 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 190/375] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:27 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:19:27.618366 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5e949d2c-58c7-484d-9800-0016724b8a5f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:27.618986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5e949d2c-58c7-484d-9800-0016724b8a5f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:27.655074 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-86b57d04-7c9b-45c0-a068-8a82810305cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28016 microversion: 2.20 time: 0.176942 Aug 19 09:19:27.655828 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 186/376] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:27 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28016 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:27.697433 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5e949d2c-58c7-484d-9800-0016724b8a5f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:27.706530 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5e949d2c-58c7-484d-9800-0016724b8a5f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1214 microversion: 2.1 time: 0.091655 Aug 19 09:19:27.707108 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 191/377] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:27 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:28.486080 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bed14945-c89a-47aa-8b22-a3fa356e37e7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:28.486542 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bed14945-c89a-47aa-8b22-a3fa356e37e7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:28.494316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bed14945-c89a-47aa-8b22-a3fa356e37e7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:28.494840 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bed14945-c89a-47aa-8b22-a3fa356e37e7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:28.495707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bed14945-c89a-47aa-8b22-a3fa356e37e7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:28.496218 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bed14945-c89a-47aa-8b22-a3fa356e37e7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:28.599862 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0b4cdffa-785d-4365-b3ab-0710ef1983a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:28.601075 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0b4cdffa-785d-4365-b3ab-0710ef1983a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:28.606801 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b4cdffa-785d-4365-b3ab-0710ef1983a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:28.607555 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b4cdffa-785d-4365-b3ab-0710ef1983a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:28.608335 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b4cdffa-785d-4365-b3ab-0710ef1983a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:28.608961 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b4cdffa-785d-4365-b3ab-0710ef1983a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:28.672826 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0b4cdffa-785d-4365-b3ab-0710ef1983a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:28.680431 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0b4cdffa-785d-4365-b3ab-0710ef1983a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1288 microversion: 2.1 time: 0.084684 Aug 19 09:19:28.680974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 192/378] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:28 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:28.685606 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-48dc86a1-e838-491a-b732-b5d73cb5c425 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:28.686505 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-48dc86a1-e838-491a-b732-b5d73cb5c425 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:28.694959 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-48dc86a1-e838-491a-b732-b5d73cb5c425 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:28.695442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-48dc86a1-e838-491a-b732-b5d73cb5c425 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:28.696255 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-48dc86a1-e838-491a-b732-b5d73cb5c425 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:28.696800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-48dc86a1-e838-491a-b732-b5d73cb5c425 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:28.715043 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bed14945-c89a-47aa-8b22-a3fa356e37e7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:28.725556 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bed14945-c89a-47aa-8b22-a3fa356e37e7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.245130 Aug 19 09:19:28.726228 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 187/379] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:28 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:28.731039 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7b737b6b-1b1d-4912-b7f0-2db268fe9d23 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:28.731739 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7b737b6b-1b1d-4912-b7f0-2db268fe9d23 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:28.737492 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b737b6b-1b1d-4912-b7f0-2db268fe9d23 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:28.737934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b737b6b-1b1d-4912-b7f0-2db268fe9d23 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:28.738695 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b737b6b-1b1d-4912-b7f0-2db268fe9d23 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:28.739130 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b737b6b-1b1d-4912-b7f0-2db268fe9d23 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:28.804082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-48dc86a1-e838-491a-b732-b5d73cb5c425 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.121582 Aug 19 09:19:28.804751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 193/380] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:28 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:28.810800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7b737b6b-1b1d-4912-b7f0-2db268fe9d23 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:28.818886 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7b737b6b-1b1d-4912-b7f0-2db268fe9d23 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1266 microversion: 2.1 time: 0.091527 Aug 19 09:19:28.820300 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 188/381] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:28 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:29.698370 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-024f41ca-0d6b-43d1-af7c-6b508eeea563 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:29.699255 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-024f41ca-0d6b-43d1-af7c-6b508eeea563 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:29.707617 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-024f41ca-0d6b-43d1-af7c-6b508eeea563 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:29.708671 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-024f41ca-0d6b-43d1-af7c-6b508eeea563 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:29.710044 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-024f41ca-0d6b-43d1-af7c-6b508eeea563 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:29.710718 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-024f41ca-0d6b-43d1-af7c-6b508eeea563 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:29.741807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-631e6dea-3dcb-4faa-9e20-2a3ee4aedae6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:29.742404 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-631e6dea-3dcb-4faa-9e20-2a3ee4aedae6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:29.748686 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-631e6dea-3dcb-4faa-9e20-2a3ee4aedae6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:29.749132 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-631e6dea-3dcb-4faa-9e20-2a3ee4aedae6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:29.749907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-631e6dea-3dcb-4faa-9e20-2a3ee4aedae6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:29.750530 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-631e6dea-3dcb-4faa-9e20-2a3ee4aedae6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:29.843383 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-024f41ca-0d6b-43d1-af7c-6b508eeea563 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:29.851364 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-024f41ca-0d6b-43d1-af7c-6b508eeea563 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.157439 Aug 19 09:19:29.851923 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 194/382] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:29 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:29.856207 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cea6b298-6863-4236-a29c-539315cb55dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:29.857101 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cea6b298-6863-4236-a29c-539315cb55dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:29.863221 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cea6b298-6863-4236-a29c-539315cb55dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:29.863700 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cea6b298-6863-4236-a29c-539315cb55dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:29.864456 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cea6b298-6863-4236-a29c-539315cb55dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:29.864881 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cea6b298-6863-4236-a29c-539315cb55dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:29.964403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cea6b298-6863-4236-a29c-539315cb55dd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.111222 Aug 19 09:19:29.965460 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 195/383] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:29 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:29.974333 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7ab6c272-bba3-4155-8a9a-67a4f362e5d3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:29.975126 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7ab6c272-bba3-4155-8a9a-67a4f362e5d3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:29.981725 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ab6c272-bba3-4155-8a9a-67a4f362e5d3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:29.982191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ab6c272-bba3-4155-8a9a-67a4f362e5d3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:29.982949 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ab6c272-bba3-4155-8a9a-67a4f362e5d3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:29.983422 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ab6c272-bba3-4155-8a9a-67a4f362e5d3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:30.052901 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7ab6c272-bba3-4155-8a9a-67a4f362e5d3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:30.060077 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7ab6c272-bba3-4155-8a9a-67a4f362e5d3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1272 microversion: 2.1 time: 0.090537 Aug 19 09:19:30.060866 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 196/384] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:29 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:30.064796 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fcc3365d-c1d4-4049-aad3-b37e3ef8a6ee tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:30.065288 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fcc3365d-c1d4-4049-aad3-b37e3ef8a6ee tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:30.071258 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fcc3365d-c1d4-4049-aad3-b37e3ef8a6ee tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:30.073236 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fcc3365d-c1d4-4049-aad3-b37e3ef8a6ee tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:30.074026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fcc3365d-c1d4-4049-aad3-b37e3ef8a6ee tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:30.074464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fcc3365d-c1d4-4049-aad3-b37e3ef8a6ee tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:30.083265 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-631e6dea-3dcb-4faa-9e20-2a3ee4aedae6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:30.092306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-fcc3365d-c1d4-4049-aad3-b37e3ef8a6ee tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] HTTP exception thrown: Instance e7d8a445-b5d9-4394-955e-6b57dda71720 could not be found. Aug 19 09:19:30.092792 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fcc3365d-c1d4-4049-aad3-b37e3ef8a6ee tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Returning 404 to user: Instance e7d8a445-b5d9-4394-955e-6b57dda71720 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:19:30.093673 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fcc3365d-c1d4-4049-aad3-b37e3ef8a6ee tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 404 len: 111 microversion: 2.1 time: 0.032137 Aug 19 09:19:30.094096 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-631e6dea-3dcb-4faa-9e20-2a3ee4aedae6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.355721 Aug 19 09:19:30.095608 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 189/386] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:29 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:30.099340 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 197/386] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:19:30 2021] DELETE /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:19:30.112175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-609bb7b0-2a83-4976-bfb0-3bad4945c247 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:30.112850 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-609bb7b0-2a83-4976-bfb0-3bad4945c247 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] [instance: e7d8a445-b5d9-4394-955e-6b57dda71720] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:30.118903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-609bb7b0-2a83-4976-bfb0-3bad4945c247 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:30.119462 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-609bb7b0-2a83-4976-bfb0-3bad4945c247 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:30.120396 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-609bb7b0-2a83-4976-bfb0-3bad4945c247 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:30.120903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-609bb7b0-2a83-4976-bfb0-3bad4945c247 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:30.134200 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-609bb7b0-2a83-4976-bfb0-3bad4945c247 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] HTTP exception thrown: Instance e7d8a445-b5d9-4394-955e-6b57dda71720 could not be found. Aug 19 09:19:30.134857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-609bb7b0-2a83-4976-bfb0-3bad4945c247 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] Returning 404 to user: Instance e7d8a445-b5d9-4394-955e-6b57dda71720 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:19:30.135792 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-609bb7b0-2a83-4976-bfb0-3bad4945c247 tempest-DeleteServersTestJSON-1684790860 tempest-DeleteServersTestJSON-1684790860-project] 10.222.0.32 "GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720" status: 404 len: 111 microversion: 2.1 time: 0.027464 Aug 19 09:19:30.136402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 190/387] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:30 2021] GET /compute/v2.1/servers/e7d8a445-b5d9-4394-955e-6b57dda71720 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:19:30.487462 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-77ce583c-c0e1-404f-86fd-dc6404d6ba62 req-307f8fc3-bda8-4278-8682-3f90ba7cf660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b887e5c3-ec85-4ff3-8685-f04ce319ec60", "tag": "c1bc4d32-4ce7-4c3a-9498-e98bcf48bd8d"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:30.491309 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:19:30.491309 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:19:30.499836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-77ce583c-c0e1-404f-86fd-dc6404d6ba62 req-307f8fc3-bda8-4278-8682-3f90ba7cf660 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:30.501399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-77ce583c-c0e1-404f-86fd-dc6404d6ba62 req-307f8fc3-bda8-4278-8682-3f90ba7cf660 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:30.514872 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-77ce583c-c0e1-404f-86fd-dc6404d6ba62 req-307f8fc3-bda8-4278-8682-3f90ba7cf660 service nova] Creating event network-changed:c1bc4d32-4ce7-4c3a-9498-e98bcf48bd8d for instance b887e5c3-ec85-4ff3-8685-f04ce319ec60 on hv-cinder-77387 Aug 19 09:19:30.520503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-77ce583c-c0e1-404f-86fd-dc6404d6ba62 req-307f8fc3-bda8-4278-8682-3f90ba7cf660 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039095 Aug 19 09:19:30.521534 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 198/388] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:19:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:30.869742 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-fcd6aecd-66d9-4675-a91d-72928f32d196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:30.871138 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-fcd6aecd-66d9-4675-a91d-72928f32d196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:30.878119 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fcd6aecd-66d9-4675-a91d-72928f32d196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:30.878742 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fcd6aecd-66d9-4675-a91d-72928f32d196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:30.879542 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fcd6aecd-66d9-4675-a91d-72928f32d196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:30.880143 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fcd6aecd-66d9-4675-a91d-72928f32d196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:30.980246 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5f944a30-6f3b-47c4-9f6c-d5cb29730c83 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:30.982419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5f944a30-6f3b-47c4-9f6c-d5cb29730c83 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:30.990069 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f944a30-6f3b-47c4-9f6c-d5cb29730c83 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:30.990766 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f944a30-6f3b-47c4-9f6c-d5cb29730c83 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:30.992200 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f944a30-6f3b-47c4-9f6c-d5cb29730c83 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:30.992785 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f944a30-6f3b-47c4-9f6c-d5cb29730c83 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:31.090644 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5f944a30-6f3b-47c4-9f6c-d5cb29730c83 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.116045 Aug 19 09:19:31.091303 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 199/389] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:30 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:31.098847 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ea478d2a-33ef-452c-ba49-49a44b986dd3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:31.099574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ea478d2a-33ef-452c-ba49-49a44b986dd3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:31.105999 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea478d2a-33ef-452c-ba49-49a44b986dd3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:31.106715 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea478d2a-33ef-452c-ba49-49a44b986dd3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:31.107549 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea478d2a-33ef-452c-ba49-49a44b986dd3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:31.107999 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea478d2a-33ef-452c-ba49-49a44b986dd3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:31.233671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-fcd6aecd-66d9-4675-a91d-72928f32d196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:31.241711 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ea478d2a-33ef-452c-ba49-49a44b986dd3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:31.245416 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-fcd6aecd-66d9-4675-a91d-72928f32d196 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.379653 Aug 19 09:19:31.246084 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 191/390] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:30 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:31.258657 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ea478d2a-33ef-452c-ba49-49a44b986dd3 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.165856 Aug 19 09:19:31.259752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 200/391] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:31 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:31.260185 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d0c351da-0bd1-4ece-b18e-81eb894fe32a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:31.260878 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d0c351da-0bd1-4ece-b18e-81eb894fe32a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:31.267019 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0c351da-0bd1-4ece-b18e-81eb894fe32a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:31.267601 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0c351da-0bd1-4ece-b18e-81eb894fe32a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:31.268598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0c351da-0bd1-4ece-b18e-81eb894fe32a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:31.269242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0c351da-0bd1-4ece-b18e-81eb894fe32a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:31.579141 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d0c351da-0bd1-4ece-b18e-81eb894fe32a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:31.586570 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d0c351da-0bd1-4ece-b18e-81eb894fe32a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1523 microversion: 2.1 time: 0.330029 Aug 19 09:19:31.589491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 192/392] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:31 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1523 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:32.102704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-32363e38-2829-4c48-9a73-8d3a62c3178c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:32.103668 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-32363e38-2829-4c48-9a73-8d3a62c3178c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:32.110331 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-32363e38-2829-4c48-9a73-8d3a62c3178c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.110807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-32363e38-2829-4c48-9a73-8d3a62c3178c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.111699 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-32363e38-2829-4c48-9a73-8d3a62c3178c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.112392 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-32363e38-2829-4c48-9a73-8d3a62c3178c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.260061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-32363e38-2829-4c48-9a73-8d3a62c3178c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.161469 Aug 19 09:19:32.260695 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 201/393] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:32 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:32.262612 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-565e12db-0ba1-4b7e-ad55-732130449b53 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:32.263868 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-565e12db-0ba1-4b7e-ad55-732130449b53 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:32.272234 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-565e12db-0ba1-4b7e-ad55-732130449b53 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.272925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-565e12db-0ba1-4b7e-ad55-732130449b53 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.274133 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-565e12db-0ba1-4b7e-ad55-732130449b53 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.275548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-565e12db-0ba1-4b7e-ad55-732130449b53 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.275842 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8e79b6f5-1623-4941-8918-2562212a5868 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:32.276647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8e79b6f5-1623-4941-8918-2562212a5868 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:32.283925 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8e79b6f5-1623-4941-8918-2562212a5868 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.284544 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8e79b6f5-1623-4941-8918-2562212a5868 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.285476 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8e79b6f5-1623-4941-8918-2562212a5868 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.286065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8e79b6f5-1623-4941-8918-2562212a5868 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.423480 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8e79b6f5-1623-4941-8918-2562212a5868 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:32.431336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8e79b6f5-1623-4941-8918-2562212a5868 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.159398 Aug 19 09:19:32.432084 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 202/394] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:32 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:32.473160 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-565e12db-0ba1-4b7e-ad55-732130449b53 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:32.481278 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-565e12db-0ba1-4b7e-ad55-732130449b53 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.222454 Aug 19 09:19:32.482390 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 193/395] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:32 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:32.540736 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-d0bda8c9-2bf3-4db6-97eb-51ae1bde2065 req-34dbea69-6264-4428-82e4-31781c21793a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc32e0f-09c3-46d7-a9d5-a44a3e48f222", "tag": "86c16351-fe7e-4beb-81f6-d02028ab6940"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:32.542353 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:19:32.542353 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:19:32.549148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-d0bda8c9-2bf3-4db6-97eb-51ae1bde2065 req-34dbea69-6264-4428-82e4-31781c21793a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.549592 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-d0bda8c9-2bf3-4db6-97eb-51ae1bde2065 req-34dbea69-6264-4428-82e4-31781c21793a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.561243 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-d0bda8c9-2bf3-4db6-97eb-51ae1bde2065 req-34dbea69-6264-4428-82e4-31781c21793a service nova] Creating event network-changed:86c16351-fe7e-4beb-81f6-d02028ab6940 for instance 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 on hv-cinder-77387 Aug 19 09:19:32.567003 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-d0bda8c9-2bf3-4db6-97eb-51ae1bde2065 req-34dbea69-6264-4428-82e4-31781c21793a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030317 Aug 19 09:19:32.568091 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 203/396] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:19:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:32.605982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ccfd5f6e-9fae-4ea2-861f-12df2ae8d469 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:32.606697 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ccfd5f6e-9fae-4ea2-861f-12df2ae8d469 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:32.612721 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ccfd5f6e-9fae-4ea2-861f-12df2ae8d469 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.613177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ccfd5f6e-9fae-4ea2-861f-12df2ae8d469 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.614215 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ccfd5f6e-9fae-4ea2-861f-12df2ae8d469 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.614706 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ccfd5f6e-9fae-4ea2-861f-12df2ae8d469 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.738261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ccfd5f6e-9fae-4ea2-861f-12df2ae8d469 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:32.747207 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ccfd5f6e-9fae-4ea2-861f-12df2ae8d469 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1503 microversion: 2.1 time: 0.144707 Aug 19 09:19:32.748401 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 194/397] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:32 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:32.764519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fd62f70b-0a6c-4d8c-8930-4b6f108e04fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:32.765363 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fd62f70b-0a6c-4d8c-8930-4b6f108e04fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:32.772657 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd62f70b-0a6c-4d8c-8930-4b6f108e04fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.773252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd62f70b-0a6c-4d8c-8930-4b6f108e04fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.774119 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd62f70b-0a6c-4d8c-8930-4b6f108e04fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:32.774751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd62f70b-0a6c-4d8c-8930-4b6f108e04fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:32.908118 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fd62f70b-0a6c-4d8c-8930-4b6f108e04fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:32.916019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fd62f70b-0a6c-4d8c-8930-4b6f108e04fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1517 microversion: 2.1 time: 0.155406 Aug 19 09:19:32.916589 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 204/398] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:32 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:33.272605 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4b7269b2-a6a2-4937-8eaf-bc883617b567 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:33.273590 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4b7269b2-a6a2-4937-8eaf-bc883617b567 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:33.280786 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4b7269b2-a6a2-4937-8eaf-bc883617b567 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:33.281333 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4b7269b2-a6a2-4937-8eaf-bc883617b567 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:33.282153 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4b7269b2-a6a2-4937-8eaf-bc883617b567 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:33.282586 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4b7269b2-a6a2-4937-8eaf-bc883617b567 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:33.406123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4b7269b2-a6a2-4937-8eaf-bc883617b567 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.136931 Aug 19 09:19:33.406804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 195/399] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:33 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:33.447695 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9d558b49-5d23-4829-84fc-7f59edf61fbd tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:33.448321 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9d558b49-5d23-4829-84fc-7f59edf61fbd tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:33.455304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9d558b49-5d23-4829-84fc-7f59edf61fbd tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:33.455812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9d558b49-5d23-4829-84fc-7f59edf61fbd tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:33.456505 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9d558b49-5d23-4829-84fc-7f59edf61fbd tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:33.456933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9d558b49-5d23-4829-84fc-7f59edf61fbd tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:33.500024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-51abb1b3-7e23-4762-8681-36f4deeb828c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:33.502700 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-51abb1b3-7e23-4762-8681-36f4deeb828c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:33.511224 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51abb1b3-7e23-4762-8681-36f4deeb828c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:33.511581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51abb1b3-7e23-4762-8681-36f4deeb828c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:33.512876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51abb1b3-7e23-4762-8681-36f4deeb828c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:33.513799 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51abb1b3-7e23-4762-8681-36f4deeb828c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:33.610815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9d558b49-5d23-4829-84fc-7f59edf61fbd tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:33.620931 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9d558b49-5d23-4829-84fc-7f59edf61fbd tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.177161 Aug 19 09:19:33.622087 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 205/400] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:33 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:33.913455 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-51abb1b3-7e23-4762-8681-36f4deeb828c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:33.920573 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-51abb1b3-7e23-4762-8681-36f4deeb828c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.425755 Aug 19 09:19:33.921118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 196/401] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:33 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:34.417817 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0d7993ab-7031-4b9b-afb2-0c95964b4b57 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:34.418833 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0d7993ab-7031-4b9b-afb2-0c95964b4b57 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:34.425186 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d7993ab-7031-4b9b-afb2-0c95964b4b57 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:34.425628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d7993ab-7031-4b9b-afb2-0c95964b4b57 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:34.426383 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d7993ab-7031-4b9b-afb2-0c95964b4b57 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:34.426812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d7993ab-7031-4b9b-afb2-0c95964b4b57 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:34.639564 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-94b22a14-f053-4a01-84a8-3eff3231e373 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:34.640184 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-94b22a14-f053-4a01-84a8-3eff3231e373 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:34.647116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-94b22a14-f053-4a01-84a8-3eff3231e373 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:34.647590 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-94b22a14-f053-4a01-84a8-3eff3231e373 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:34.648369 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-94b22a14-f053-4a01-84a8-3eff3231e373 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:34.648801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-94b22a14-f053-4a01-84a8-3eff3231e373 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:34.681403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0d7993ab-7031-4b9b-afb2-0c95964b4b57 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.266876 Aug 19 09:19:34.682528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 206/402] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:34 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:34.786854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-94b22a14-f053-4a01-84a8-3eff3231e373 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:34.793946 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-94b22a14-f053-4a01-84a8-3eff3231e373 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.159218 Aug 19 09:19:34.794495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 197/403] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:34 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:34.938198 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-601c9152-7a0b-4dc7-8a9c-2a0eb02cb39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:34.938905 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-601c9152-7a0b-4dc7-8a9c-2a0eb02cb39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:34.945152 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-601c9152-7a0b-4dc7-8a9c-2a0eb02cb39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:34.945590 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-601c9152-7a0b-4dc7-8a9c-2a0eb02cb39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:34.946342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-601c9152-7a0b-4dc7-8a9c-2a0eb02cb39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:34.946768 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-601c9152-7a0b-4dc7-8a9c-2a0eb02cb39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:35.070876 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-601c9152-7a0b-4dc7-8a9c-2a0eb02cb39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:35.077961 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-601c9152-7a0b-4dc7-8a9c-2a0eb02cb39e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.143773 Aug 19 09:19:35.079402 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 207/404] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:34 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:35.693418 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-db07a36e-f21d-4f77-988f-ecf5c7a663dc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:35.694396 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-db07a36e-f21d-4f77-988f-ecf5c7a663dc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:35.700085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-db07a36e-f21d-4f77-988f-ecf5c7a663dc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:35.700534 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-db07a36e-f21d-4f77-988f-ecf5c7a663dc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:35.701272 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-db07a36e-f21d-4f77-988f-ecf5c7a663dc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:35.701696 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-db07a36e-f21d-4f77-988f-ecf5c7a663dc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:35.810574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b9d26581-b8d1-4db2-b6b4-5c084334d6a1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:35.811181 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b9d26581-b8d1-4db2-b6b4-5c084334d6a1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:35.817799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b9d26581-b8d1-4db2-b6b4-5c084334d6a1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:35.818239 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b9d26581-b8d1-4db2-b6b4-5c084334d6a1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:35.819059 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b9d26581-b8d1-4db2-b6b4-5c084334d6a1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:35.819537 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b9d26581-b8d1-4db2-b6b4-5c084334d6a1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:35.945560 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b9d26581-b8d1-4db2-b6b4-5c084334d6a1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:35.952529 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b9d26581-b8d1-4db2-b6b4-5c084334d6a1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.145561 Aug 19 09:19:35.953079 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 208/405] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:35 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:35.966061 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-db07a36e-f21d-4f77-988f-ecf5c7a663dc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.276044 Aug 19 09:19:35.967003 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 198/406] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:35 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:36.093611 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5f874cea-a93f-4d10-96e1-62023d3a4334 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:36.094628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5f874cea-a93f-4d10-96e1-62023d3a4334 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:36.101071 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f874cea-a93f-4d10-96e1-62023d3a4334 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:36.101515 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f874cea-a93f-4d10-96e1-62023d3a4334 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:36.102280 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f874cea-a93f-4d10-96e1-62023d3a4334 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:36.102709 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f874cea-a93f-4d10-96e1-62023d3a4334 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:36.226190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5f874cea-a93f-4d10-96e1-62023d3a4334 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:36.233439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5f874cea-a93f-4d10-96e1-62023d3a4334 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.143679 Aug 19 09:19:36.239845 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 209/407] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:36 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:36.427973 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-00fc1a93-4732-4a12-a88e-4f0869c4498a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:36.428999 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-00fc1a93-4732-4a12-a88e-4f0869c4498a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:36.435383 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00fc1a93-4732-4a12-a88e-4f0869c4498a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:36.435943 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00fc1a93-4732-4a12-a88e-4f0869c4498a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:36.436604 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00fc1a93-4732-4a12-a88e-4f0869c4498a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:36.437037 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-00fc1a93-4732-4a12-a88e-4f0869c4498a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:36.462349 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-00fc1a93-4732-4a12-a88e-4f0869c4498a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lazy-loading 'flavor' on Instance uuid f4c3bc8f-45ae-4a40-8a3d-d9642d8728df {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:19:36.574970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-00fc1a93-4732-4a12-a88e-4f0869c4498a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/action" status: 200 len: 32 microversion: 2.1 time: 0.151052 Aug 19 09:19:36.575504 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 199/408] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:19:36 2021] POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:19:36.584933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4b837a32-7e27-4b90-8205-8908ed03312c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:36.585754 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4b837a32-7e27-4b90-8205-8908ed03312c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:36.591242 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b837a32-7e27-4b90-8205-8908ed03312c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:36.591722 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b837a32-7e27-4b90-8205-8908ed03312c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:36.592504 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b837a32-7e27-4b90-8205-8908ed03312c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:36.592932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b837a32-7e27-4b90-8205-8908ed03312c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:36.713826 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4b837a32-7e27-4b90-8205-8908ed03312c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:36.721803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4b837a32-7e27-4b90-8205-8908ed03312c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.140501 Aug 19 09:19:36.722433 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 210/409] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:36 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:36.970548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-617bc749-b010-44b2-a3b9-2b25fb35c756 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:36.971353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-617bc749-b010-44b2-a3b9-2b25fb35c756 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:36.978296 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-617bc749-b010-44b2-a3b9-2b25fb35c756 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:36.978838 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-617bc749-b010-44b2-a3b9-2b25fb35c756 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:36.979850 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-617bc749-b010-44b2-a3b9-2b25fb35c756 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:36.980537 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a4e5460e-ccc3-4a32-bd98-6e93b0c700f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:36.981127 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-617bc749-b010-44b2-a3b9-2b25fb35c756 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:36.981691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a4e5460e-ccc3-4a32-bd98-6e93b0c700f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:36.997008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4e5460e-ccc3-4a32-bd98-6e93b0c700f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:36.997477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4e5460e-ccc3-4a32-bd98-6e93b0c700f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:36.998253 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4e5460e-ccc3-4a32-bd98-6e93b0c700f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:36.998713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4e5460e-ccc3-4a32-bd98-6e93b0c700f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:37.166234 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-617bc749-b010-44b2-a3b9-2b25fb35c756 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:37.173468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-617bc749-b010-44b2-a3b9-2b25fb35c756 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.207695 Aug 19 09:19:37.174111 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 200/410] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:36 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:37.249554 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e624c0a1-5cbe-4239-860d-191af4ce310a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:37.250117 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e624c0a1-5cbe-4239-860d-191af4ce310a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:37.256017 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e624c0a1-5cbe-4239-860d-191af4ce310a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:37.256461 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e624c0a1-5cbe-4239-860d-191af4ce310a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:37.257220 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e624c0a1-5cbe-4239-860d-191af4ce310a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:37.257659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e624c0a1-5cbe-4239-860d-191af4ce310a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:37.330335 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a4e5460e-ccc3-4a32-bd98-6e93b0c700f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.355867 Aug 19 09:19:37.334130 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 211/411] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:36 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:37.375805 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e624c0a1-5cbe-4239-860d-191af4ce310a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:37.383011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e624c0a1-5cbe-4239-860d-191af4ce310a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.137095 Aug 19 09:19:37.383603 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 201/412] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:37 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:37.739593 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ffce8794-b0c3-44e0-a3ca-d6013399a8a3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:37.740236 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ffce8794-b0c3-44e0-a3ca-d6013399a8a3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:37.746567 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ffce8794-b0c3-44e0-a3ca-d6013399a8a3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:37.747010 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ffce8794-b0c3-44e0-a3ca-d6013399a8a3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:37.747795 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ffce8794-b0c3-44e0-a3ca-d6013399a8a3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:37.748227 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ffce8794-b0c3-44e0-a3ca-d6013399a8a3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:37.869653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ffce8794-b0c3-44e0-a3ca-d6013399a8a3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:37.884416 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ffce8794-b0c3-44e0-a3ca-d6013399a8a3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.142038 Aug 19 09:19:37.884416 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 212/413] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:37 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:38.191699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f7e1a953-55a4-4ab0-912f-94cacf2a5953 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:38.195958 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f7e1a953-55a4-4ab0-912f-94cacf2a5953 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:38.202136 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f7e1a953-55a4-4ab0-912f-94cacf2a5953 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:38.202586 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f7e1a953-55a4-4ab0-912f-94cacf2a5953 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:38.203495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f7e1a953-55a4-4ab0-912f-94cacf2a5953 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:38.203978 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f7e1a953-55a4-4ab0-912f-94cacf2a5953 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:38.332441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f7e1a953-55a4-4ab0-912f-94cacf2a5953 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:38.339765 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f7e1a953-55a4-4ab0-912f-94cacf2a5953 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.153632 Aug 19 09:19:38.340325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 202/414] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:38 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:38.341689 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e502684f-d6bc-4919-959c-0236ab0541a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:38.342602 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e502684f-d6bc-4919-959c-0236ab0541a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:38.348613 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e502684f-d6bc-4919-959c-0236ab0541a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:38.349069 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e502684f-d6bc-4919-959c-0236ab0541a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:38.349822 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e502684f-d6bc-4919-959c-0236ab0541a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:38.350246 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e502684f-d6bc-4919-959c-0236ab0541a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:38.400744 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-abb4012a-604c-42b5-a01e-adabca457a6b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:38.401354 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-abb4012a-604c-42b5-a01e-adabca457a6b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:38.407109 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-abb4012a-604c-42b5-a01e-adabca457a6b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:38.407591 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-abb4012a-604c-42b5-a01e-adabca457a6b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:38.408351 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-abb4012a-604c-42b5-a01e-adabca457a6b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:38.408809 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-abb4012a-604c-42b5-a01e-adabca457a6b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:38.450068 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e502684f-d6bc-4919-959c-0236ab0541a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.111810 Aug 19 09:19:38.452949 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 213/415] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:38 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:38.533589 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-abb4012a-604c-42b5-a01e-adabca457a6b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:38.540952 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-abb4012a-604c-42b5-a01e-adabca457a6b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.144114 Aug 19 09:19:38.541623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 203/416] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:38 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:38.894929 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c9d39edf-6462-4928-9d85-efe626c9bfe4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:38.895654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c9d39edf-6462-4928-9d85-efe626c9bfe4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:38.901963 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c9d39edf-6462-4928-9d85-efe626c9bfe4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:38.902402 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c9d39edf-6462-4928-9d85-efe626c9bfe4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:38.903154 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c9d39edf-6462-4928-9d85-efe626c9bfe4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:38.903648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c9d39edf-6462-4928-9d85-efe626c9bfe4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:39.028184 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c9d39edf-6462-4928-9d85-efe626c9bfe4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:39.037813 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c9d39edf-6462-4928-9d85-efe626c9bfe4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.145930 Aug 19 09:19:39.047531 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 214/417] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:38 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:39.356294 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-19f76b49-c0d0-4bae-a440-0194ba30013c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:39.356927 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-19f76b49-c0d0-4bae-a440-0194ba30013c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:39.363335 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19f76b49-c0d0-4bae-a440-0194ba30013c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:39.363778 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19f76b49-c0d0-4bae-a440-0194ba30013c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:39.364549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19f76b49-c0d0-4bae-a440-0194ba30013c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:39.364953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19f76b49-c0d0-4bae-a440-0194ba30013c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:39.461638 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-02d8ffbd-5399-416b-a294-e8261bb2b106 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:39.462691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-02d8ffbd-5399-416b-a294-e8261bb2b106 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:39.468438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-02d8ffbd-5399-416b-a294-e8261bb2b106 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:39.469453 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-02d8ffbd-5399-416b-a294-e8261bb2b106 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:39.470305 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-02d8ffbd-5399-416b-a294-e8261bb2b106 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:39.470810 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-02d8ffbd-5399-416b-a294-e8261bb2b106 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:39.482293 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-19f76b49-c0d0-4bae-a440-0194ba30013c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:39.490360 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-19f76b49-c0d0-4bae-a440-0194ba30013c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.137680 Aug 19 09:19:39.490911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 204/418] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:39 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:39.558050 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b4d4ec40-e6e8-43bd-bb99-f4c96ad830c1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:39.558623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b4d4ec40-e6e8-43bd-bb99-f4c96ad830c1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:39.564592 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b4d4ec40-e6e8-43bd-bb99-f4c96ad830c1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:39.565033 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b4d4ec40-e6e8-43bd-bb99-f4c96ad830c1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:39.565813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b4d4ec40-e6e8-43bd-bb99-f4c96ad830c1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:39.566242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b4d4ec40-e6e8-43bd-bb99-f4c96ad830c1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:39.593754 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-02d8ffbd-5399-416b-a294-e8261bb2b106 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.135536 Aug 19 09:19:39.594898 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 215/419] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:39 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:39.688229 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b4d4ec40-e6e8-43bd-bb99-f4c96ad830c1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:39.695558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b4d4ec40-e6e8-43bd-bb99-f4c96ad830c1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.141103 Aug 19 09:19:39.696110 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 205/420] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:39 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:40.053884 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5a661c7a-0000-46e7-9980-e696ca3ab4ea tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:40.054599 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5a661c7a-0000-46e7-9980-e696ca3ab4ea tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:40.060948 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5a661c7a-0000-46e7-9980-e696ca3ab4ea tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:40.061395 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5a661c7a-0000-46e7-9980-e696ca3ab4ea tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:40.062155 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5a661c7a-0000-46e7-9980-e696ca3ab4ea tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:40.063163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5a661c7a-0000-46e7-9980-e696ca3ab4ea tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:40.189164 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5a661c7a-0000-46e7-9980-e696ca3ab4ea tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:40.196639 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5a661c7a-0000-46e7-9980-e696ca3ab4ea tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.146733 Aug 19 09:19:40.197384 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 216/421] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:40 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:40.507057 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f2a07e6a-374b-40a9-9914-3ac55e4342b2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:40.507715 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f2a07e6a-374b-40a9-9914-3ac55e4342b2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:40.514095 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2a07e6a-374b-40a9-9914-3ac55e4342b2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:40.514550 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2a07e6a-374b-40a9-9914-3ac55e4342b2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:40.515350 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2a07e6a-374b-40a9-9914-3ac55e4342b2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:40.515814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2a07e6a-374b-40a9-9914-3ac55e4342b2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:40.605734 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7f17c215-b0cf-4a2e-8966-0ee8aab8dd40 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:40.606640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7f17c215-b0cf-4a2e-8966-0ee8aab8dd40 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:40.613630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f17c215-b0cf-4a2e-8966-0ee8aab8dd40 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:40.614151 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f17c215-b0cf-4a2e-8966-0ee8aab8dd40 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:40.615028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f17c215-b0cf-4a2e-8966-0ee8aab8dd40 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:40.615710 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f17c215-b0cf-4a2e-8966-0ee8aab8dd40 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:40.647033 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f2a07e6a-374b-40a9-9914-3ac55e4342b2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:40.654182 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f2a07e6a-374b-40a9-9914-3ac55e4342b2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.150754 Aug 19 09:19:40.654935 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 206/422] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:40 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:40.712697 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b2bdc86a-a2f6-400f-aea8-e52fc7982792 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:40.713388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b2bdc86a-a2f6-400f-aea8-e52fc7982792 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:40.720495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2bdc86a-a2f6-400f-aea8-e52fc7982792 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:40.721140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2bdc86a-a2f6-400f-aea8-e52fc7982792 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:40.721970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2bdc86a-a2f6-400f-aea8-e52fc7982792 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:40.722559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2bdc86a-a2f6-400f-aea8-e52fc7982792 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:40.797696 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7f17c215-b0cf-4a2e-8966-0ee8aab8dd40 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.194655 Aug 19 09:19:40.798560 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 217/423] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:40 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:40.889199 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b2bdc86a-a2f6-400f-aea8-e52fc7982792 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:40.896522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b2bdc86a-a2f6-400f-aea8-e52fc7982792 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.187520 Aug 19 09:19:40.897007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 207/424] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:40 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:41.214091 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e98e1507-aebb-47e4-acc6-0f57bdac717d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:41.214784 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e98e1507-aebb-47e4-acc6-0f57bdac717d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:41.221997 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e98e1507-aebb-47e4-acc6-0f57bdac717d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:41.222454 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e98e1507-aebb-47e4-acc6-0f57bdac717d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:41.223224 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e98e1507-aebb-47e4-acc6-0f57bdac717d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:41.223946 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e98e1507-aebb-47e4-acc6-0f57bdac717d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:41.349251 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e98e1507-aebb-47e4-acc6-0f57bdac717d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:41.357076 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e98e1507-aebb-47e4-acc6-0f57bdac717d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.146917 Aug 19 09:19:41.357647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 218/425] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:41 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:41.671197 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-67a40a45-3d8c-41f1-90e4-8d114fd810af tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:41.671773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-67a40a45-3d8c-41f1-90e4-8d114fd810af tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:41.677717 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67a40a45-3d8c-41f1-90e4-8d114fd810af tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:41.678163 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67a40a45-3d8c-41f1-90e4-8d114fd810af tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:41.678924 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67a40a45-3d8c-41f1-90e4-8d114fd810af tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:41.679376 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67a40a45-3d8c-41f1-90e4-8d114fd810af tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:41.803002 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-67a40a45-3d8c-41f1-90e4-8d114fd810af tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:41.809622 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-67ac2fc6-d98b-410d-b062-95a2742efc3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:41.810331 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-67a40a45-3d8c-41f1-90e4-8d114fd810af tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.142701 Aug 19 09:19:41.810962 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 208/426] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:41 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:41.811462 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-67ac2fc6-d98b-410d-b062-95a2742efc3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:41.817826 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-67ac2fc6-d98b-410d-b062-95a2742efc3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:41.818267 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-67ac2fc6-d98b-410d-b062-95a2742efc3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:41.819025 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-67ac2fc6-d98b-410d-b062-95a2742efc3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:41.819488 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-67ac2fc6-d98b-410d-b062-95a2742efc3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:41.916019 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d21606dd-f705-44ee-b18d-a2ae7436d398 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:41.916989 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d21606dd-f705-44ee-b18d-a2ae7436d398 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:41.919988 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-67ac2fc6-d98b-410d-b062-95a2742efc3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.113420 Aug 19 09:19:41.925162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 219/427] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:41 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:41.929097 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d21606dd-f705-44ee-b18d-a2ae7436d398 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:41.929548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d21606dd-f705-44ee-b18d-a2ae7436d398 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:41.930536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d21606dd-f705-44ee-b18d-a2ae7436d398 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:41.930967 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d21606dd-f705-44ee-b18d-a2ae7436d398 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:42.046786 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-90f0ca1c-1e84-45e0-ac69-8c50bd1c58a6 req-53a3efa9-81b2-44c2-94bf-c066ba573b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc32e0f-09c3-46d7-a9d5-a44a3e48f222", "name": "network-vif-plugged", "status": "completed", "tag": "86c16351-fe7e-4beb-81f6-d02028ab6940"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:42.049066 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:19:42.049066 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:19:42.057789 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-90f0ca1c-1e84-45e0-ac69-8c50bd1c58a6 req-53a3efa9-81b2-44c2-94bf-c066ba573b06 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:42.058270 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-90f0ca1c-1e84-45e0-ac69-8c50bd1c58a6 req-53a3efa9-81b2-44c2-94bf-c066ba573b06 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:42.076931 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d21606dd-f705-44ee-b18d-a2ae7436d398 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:42.080272 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-90f0ca1c-1e84-45e0-ac69-8c50bd1c58a6 req-53a3efa9-81b2-44c2-94bf-c066ba573b06 service nova] Creating event network-vif-plugged:86c16351-fe7e-4beb-81f6-d02028ab6940 for instance 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 on hv-cinder-77387 Aug 19 09:19:42.085068 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-90f0ca1c-1e84-45e0-ac69-8c50bd1c58a6 req-53a3efa9-81b2-44c2-94bf-c066ba573b06 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043611 Aug 19 09:19:42.085687 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d21606dd-f705-44ee-b18d-a2ae7436d398 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.175313 Aug 19 09:19:42.086243 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 209/429] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:41 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:42.086374 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 220/429] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:19:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:42.374095 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ec33cc50-a84c-46ea-8015-4e48ba8a3863 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:42.374790 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ec33cc50-a84c-46ea-8015-4e48ba8a3863 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:42.381221 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec33cc50-a84c-46ea-8015-4e48ba8a3863 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:42.381662 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec33cc50-a84c-46ea-8015-4e48ba8a3863 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:42.382421 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec33cc50-a84c-46ea-8015-4e48ba8a3863 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:42.382849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec33cc50-a84c-46ea-8015-4e48ba8a3863 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:42.509603 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ec33cc50-a84c-46ea-8015-4e48ba8a3863 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:42.517254 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ec33cc50-a84c-46ea-8015-4e48ba8a3863 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.147089 Aug 19 09:19:42.517811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 221/430] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:42 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:42.827167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-850f6c36-26c7-48d1-8c73-e08b5ee96e2f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:42.827801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-850f6c36-26c7-48d1-8c73-e08b5ee96e2f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:42.834198 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-850f6c36-26c7-48d1-8c73-e08b5ee96e2f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:42.834635 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-850f6c36-26c7-48d1-8c73-e08b5ee96e2f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:42.835680 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-850f6c36-26c7-48d1-8c73-e08b5ee96e2f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:42.836112 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-850f6c36-26c7-48d1-8c73-e08b5ee96e2f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:42.932033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-36de4ec8-db02-4fd3-bc0a-9a33d218bd89 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:42.932972 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-36de4ec8-db02-4fd3-bc0a-9a33d218bd89 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:42.938665 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-36de4ec8-db02-4fd3-bc0a-9a33d218bd89 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:42.939110 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-36de4ec8-db02-4fd3-bc0a-9a33d218bd89 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:42.939911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-36de4ec8-db02-4fd3-bc0a-9a33d218bd89 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:42.940340 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-36de4ec8-db02-4fd3-bc0a-9a33d218bd89 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:42.957456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-850f6c36-26c7-48d1-8c73-e08b5ee96e2f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:42.964525 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-850f6c36-26c7-48d1-8c73-e08b5ee96e2f tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.140884 Aug 19 09:19:42.965066 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 210/431] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:42 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:43.093314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-36de4ec8-db02-4fd3-bc0a-9a33d218bd89 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.164685 Aug 19 09:19:43.094163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 222/432] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:42 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:43.102332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5e0471f3-6f79-4bb4-9a74-5177feb2b294 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:43.102936 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5e0471f3-6f79-4bb4-9a74-5177feb2b294 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:43.108680 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5e0471f3-6f79-4bb4-9a74-5177feb2b294 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:43.109116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5e0471f3-6f79-4bb4-9a74-5177feb2b294 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:43.109875 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5e0471f3-6f79-4bb4-9a74-5177feb2b294 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:43.110403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5e0471f3-6f79-4bb4-9a74-5177feb2b294 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:43.227160 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5e0471f3-6f79-4bb4-9a74-5177feb2b294 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:43.234170 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5e0471f3-6f79-4bb4-9a74-5177feb2b294 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.135659 Aug 19 09:19:43.234755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 211/433] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:43 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:43.534547 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-467acd4c-1d44-47cd-8773-af3d6649bfb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:43.535320 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-467acd4c-1d44-47cd-8773-af3d6649bfb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:43.541665 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-467acd4c-1d44-47cd-8773-af3d6649bfb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:43.542116 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-467acd4c-1d44-47cd-8773-af3d6649bfb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:43.542879 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-467acd4c-1d44-47cd-8773-af3d6649bfb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:43.543332 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-467acd4c-1d44-47cd-8773-af3d6649bfb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:43.662992 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-467acd4c-1d44-47cd-8773-af3d6649bfb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:43.670151 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-467acd4c-1d44-47cd-8773-af3d6649bfb6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.139551 Aug 19 09:19:43.670698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 223/434] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:43 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:43.981462 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-eb0d53be-91c8-4f93-aa7b-b5fefb600279 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:43.982085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-eb0d53be-91c8-4f93-aa7b-b5fefb600279 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:43.989254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-eb0d53be-91c8-4f93-aa7b-b5fefb600279 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:43.989704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-eb0d53be-91c8-4f93-aa7b-b5fefb600279 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:43.990468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-eb0d53be-91c8-4f93-aa7b-b5fefb600279 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:43.990902 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-eb0d53be-91c8-4f93-aa7b-b5fefb600279 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:44.102563 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-5f42eda5-af2b-4010-ad16-c22361a0611c req-d3ff3bb5-71ce-41b2-ba38-3def7ccff24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b887e5c3-ec85-4ff3-8685-f04ce319ec60", "name": "network-vif-plugged", "status": "completed", "tag": "c1bc4d32-4ce7-4c3a-9498-e98bcf48bd8d"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:44.104158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:19:44.104158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:19:44.111766 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-eb0d53be-91c8-4f93-aa7b-b5fefb600279 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:44.114065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-5f42eda5-af2b-4010-ad16-c22361a0611c req-d3ff3bb5-71ce-41b2-ba38-3def7ccff24e service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:44.114519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-5f42eda5-af2b-4010-ad16-c22361a0611c req-d3ff3bb5-71ce-41b2-ba38-3def7ccff24e service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:44.119533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-eb0d53be-91c8-4f93-aa7b-b5fefb600279 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.141765 Aug 19 09:19:44.120178 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 212/435] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:43 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:44.124660 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e40315f9-d427-4f8d-94e2-46841d2439a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:44.125897 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e40315f9-d427-4f8d-94e2-46841d2439a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:44.131771 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e40315f9-d427-4f8d-94e2-46841d2439a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:44.132211 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e40315f9-d427-4f8d-94e2-46841d2439a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:44.132984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e40315f9-d427-4f8d-94e2-46841d2439a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:44.133719 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e40315f9-d427-4f8d-94e2-46841d2439a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:44.240091 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e40315f9-d427-4f8d-94e2-46841d2439a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.118624 Aug 19 09:19:44.240737 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 213/436] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:44 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:44.251439 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ebfa5569-0ccf-4f8b-a014-3f2e4d126aa6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:44.252156 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ebfa5569-0ccf-4f8b-a014-3f2e4d126aa6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:44.259609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ebfa5569-0ccf-4f8b-a014-3f2e4d126aa6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:44.260056 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ebfa5569-0ccf-4f8b-a014-3f2e4d126aa6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:44.260838 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ebfa5569-0ccf-4f8b-a014-3f2e4d126aa6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:44.261266 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ebfa5569-0ccf-4f8b-a014-3f2e4d126aa6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:44.279958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-5f42eda5-af2b-4010-ad16-c22361a0611c req-d3ff3bb5-71ce-41b2-ba38-3def7ccff24e service nova] Creating event network-vif-plugged:c1bc4d32-4ce7-4c3a-9498-e98bcf48bd8d for instance b887e5c3-ec85-4ff3-8685-f04ce319ec60 on hv-cinder-77387 Aug 19 09:19:44.285754 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-5f42eda5-af2b-4010-ad16-c22361a0611c req-d3ff3bb5-71ce-41b2-ba38-3def7ccff24e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186858 Aug 19 09:19:44.286743 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 224/437] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:19:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:19:44.417420 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ebfa5569-0ccf-4f8b-a014-3f2e4d126aa6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:44.425171 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ebfa5569-0ccf-4f8b-a014-3f2e4d126aa6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.178490 Aug 19 09:19:44.425746 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 214/438] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:44 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:44.688396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cf609da8-4a8a-4078-bf9b-25089d7681fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:44.689194 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cf609da8-4a8a-4078-bf9b-25089d7681fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:44.695300 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cf609da8-4a8a-4078-bf9b-25089d7681fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:44.695886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cf609da8-4a8a-4078-bf9b-25089d7681fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:44.696713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cf609da8-4a8a-4078-bf9b-25089d7681fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:44.697210 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cf609da8-4a8a-4078-bf9b-25089d7681fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:44.820380 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cf609da8-4a8a-4078-bf9b-25089d7681fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:44.827485 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cf609da8-4a8a-4078-bf9b-25089d7681fa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.143971 Aug 19 09:19:44.828682 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 225/439] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:44 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:45.136262 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-460f036b-9940-42c5-a467-721e76f64c98 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:45.136936 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-460f036b-9940-42c5-a467-721e76f64c98 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:45.142704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-460f036b-9940-42c5-a467-721e76f64c98 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:45.143143 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-460f036b-9940-42c5-a467-721e76f64c98 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:45.143988 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-460f036b-9940-42c5-a467-721e76f64c98 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:45.144430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-460f036b-9940-42c5-a467-721e76f64c98 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:45.251365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-93ef1c83-664e-4ecb-b58f-f25b1ba0977c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:45.252208 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-93ef1c83-664e-4ecb-b58f-f25b1ba0977c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:45.257917 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93ef1c83-664e-4ecb-b58f-f25b1ba0977c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:45.258366 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93ef1c83-664e-4ecb-b58f-f25b1ba0977c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:45.259385 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93ef1c83-664e-4ecb-b58f-f25b1ba0977c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:45.259815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93ef1c83-664e-4ecb-b58f-f25b1ba0977c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:45.263536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-460f036b-9940-42c5-a467-721e76f64c98 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:45.271079 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-460f036b-9940-42c5-a467-721e76f64c98 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1314 microversion: 2.1 time: 0.138406 Aug 19 09:19:45.271733 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 215/440] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:45 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:45.444027 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2f20cf44-0eba-4003-8fe6-7219004fb0ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:45.444646 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2f20cf44-0eba-4003-8fe6-7219004fb0ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:45.450303 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2f20cf44-0eba-4003-8fe6-7219004fb0ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:45.450746 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2f20cf44-0eba-4003-8fe6-7219004fb0ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:45.451536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2f20cf44-0eba-4003-8fe6-7219004fb0ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:45.451969 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2f20cf44-0eba-4003-8fe6-7219004fb0ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:45.480693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-93ef1c83-664e-4ecb-b58f-f25b1ba0977c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.233027 Aug 19 09:19:45.485092 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 226/441] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:45 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:45.578592 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2f20cf44-0eba-4003-8fe6-7219004fb0ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:45.585680 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2f20cf44-0eba-4003-8fe6-7219004fb0ad tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.145238 Aug 19 09:19:45.586441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 216/442] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:45 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:45.845226 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d5ccc08d-2357-4270-a6dc-fff1ecb7756a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:45.845919 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d5ccc08d-2357-4270-a6dc-fff1ecb7756a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:45.852545 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5ccc08d-2357-4270-a6dc-fff1ecb7756a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:45.852993 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5ccc08d-2357-4270-a6dc-fff1ecb7756a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:45.853749 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5ccc08d-2357-4270-a6dc-fff1ecb7756a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:45.854177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5ccc08d-2357-4270-a6dc-fff1ecb7756a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:45.986080 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d5ccc08d-2357-4270-a6dc-fff1ecb7756a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:45.993161 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d5ccc08d-2357-4270-a6dc-fff1ecb7756a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.152476 Aug 19 09:19:45.993702 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 227/443] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:45 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:46.288503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e330c4a1-2c2b-4ffe-a49b-0c73c0293611 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:46.289198 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e330c4a1-2c2b-4ffe-a49b-0c73c0293611 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:46.295186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e330c4a1-2c2b-4ffe-a49b-0c73c0293611 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:46.295691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e330c4a1-2c2b-4ffe-a49b-0c73c0293611 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:46.296459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e330c4a1-2c2b-4ffe-a49b-0c73c0293611 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:46.297451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e330c4a1-2c2b-4ffe-a49b-0c73c0293611 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:46.466693 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e330c4a1-2c2b-4ffe-a49b-0c73c0293611 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:46.473797 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e330c4a1-2c2b-4ffe-a49b-0c73c0293611 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1498 microversion: 2.1 time: 0.189062 Aug 19 09:19:46.474518 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 217/444] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:46 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1498 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:46.492468 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e6d4f568-8a6b-4ed8-92ca-2b7f17d899f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:46.493425 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e6d4f568-8a6b-4ed8-92ca-2b7f17d899f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:46.499615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e6d4f568-8a6b-4ed8-92ca-2b7f17d899f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:46.500110 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e6d4f568-8a6b-4ed8-92ca-2b7f17d899f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:46.500892 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e6d4f568-8a6b-4ed8-92ca-2b7f17d899f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:46.501318 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e6d4f568-8a6b-4ed8-92ca-2b7f17d899f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:46.601664 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e1ef7b4e-d62b-4df5-86a3-51f1a28c8855 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:46.602272 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e1ef7b4e-d62b-4df5-86a3-51f1a28c8855 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:46.607943 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e1ef7b4e-d62b-4df5-86a3-51f1a28c8855 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:46.608386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e1ef7b4e-d62b-4df5-86a3-51f1a28c8855 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:46.609143 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e1ef7b4e-d62b-4df5-86a3-51f1a28c8855 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:46.609606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e1ef7b4e-d62b-4df5-86a3-51f1a28c8855 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:46.620770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e6d4f568-8a6b-4ed8-92ca-2b7f17d899f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.131591 Aug 19 09:19:46.621996 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 228/445] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:46 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:46.883055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e1ef7b4e-d62b-4df5-86a3-51f1a28c8855 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:46.890512 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e1ef7b4e-d62b-4df5-86a3-51f1a28c8855 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1318 microversion: 2.1 time: 0.292618 Aug 19 09:19:46.891708 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 218/446] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:46 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:47.010328 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-623ad04a-5d8c-482a-aaa6-442e842628af tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:47.011132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-623ad04a-5d8c-482a-aaa6-442e842628af tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:47.020989 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-623ad04a-5d8c-482a-aaa6-442e842628af tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:47.021711 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-623ad04a-5d8c-482a-aaa6-442e842628af tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:47.022818 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-623ad04a-5d8c-482a-aaa6-442e842628af tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:47.024232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-623ad04a-5d8c-482a-aaa6-442e842628af tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:47.084243 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1943e323-1b3f-495b-b1be-5d8b0b95f264 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:47.084850 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1943e323-1b3f-495b-b1be-5d8b0b95f264 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:47.091260 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1943e323-1b3f-495b-b1be-5d8b0b95f264 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:47.091793 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1943e323-1b3f-495b-b1be-5d8b0b95f264 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:47.092625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1943e323-1b3f-495b-b1be-5d8b0b95f264 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:47.093120 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1943e323-1b3f-495b-b1be-5d8b0b95f264 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:47.120308 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1943e323-1b3f-495b-b1be-5d8b0b95f264 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:19:47.171369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-623ad04a-5d8c-482a-aaa6-442e842628af tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:47.179860 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-623ad04a-5d8c-482a-aaa6-442e842628af tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.173602 Aug 19 09:19:47.190399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 229/447] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:47 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:47.200102 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1943e323-1b3f-495b-b1be-5d8b0b95f264 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 204 len: 0 microversion: 2.1 time: 0.119347 Aug 19 09:19:47.200868 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 219/448] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:19:47 2021] DELETE /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 09:19:47.209979 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-268d4033-5b96-47b1-bc94-1f7d2f0d5e90 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:47.210679 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-268d4033-5b96-47b1-bc94-1f7d2f0d5e90 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:47.216586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-268d4033-5b96-47b1-bc94-1f7d2f0d5e90 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:47.217034 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-268d4033-5b96-47b1-bc94-1f7d2f0d5e90 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:47.217801 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-268d4033-5b96-47b1-bc94-1f7d2f0d5e90 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:47.218236 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-268d4033-5b96-47b1-bc94-1f7d2f0d5e90 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:47.340623 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-268d4033-5b96-47b1-bc94-1f7d2f0d5e90 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:47.348918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-268d4033-5b96-47b1-bc94-1f7d2f0d5e90 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1504 microversion: 2.1 time: 0.142181 Aug 19 09:19:47.349669 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 230/449] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:47 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1504 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:47.633263 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2cafdc01-2d38-46da-b192-9e01e9122ba3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:47.634251 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2cafdc01-2d38-46da-b192-9e01e9122ba3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:47.640373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2cafdc01-2d38-46da-b192-9e01e9122ba3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:47.641508 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2cafdc01-2d38-46da-b192-9e01e9122ba3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:47.642365 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2cafdc01-2d38-46da-b192-9e01e9122ba3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:47.642796 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2cafdc01-2d38-46da-b192-9e01e9122ba3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:47.756388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2cafdc01-2d38-46da-b192-9e01e9122ba3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.126917 Aug 19 09:19:47.757016 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 220/450] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:47 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:47.907131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-10d4921e-d8bb-4b51-8fa7-90e9c39aeb01 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:47.907774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-10d4921e-d8bb-4b51-8fa7-90e9c39aeb01 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:47.913562 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10d4921e-d8bb-4b51-8fa7-90e9c39aeb01 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:47.914013 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10d4921e-d8bb-4b51-8fa7-90e9c39aeb01 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:47.914776 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10d4921e-d8bb-4b51-8fa7-90e9c39aeb01 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:47.915212 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10d4921e-d8bb-4b51-8fa7-90e9c39aeb01 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.039044 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-10d4921e-d8bb-4b51-8fa7-90e9c39aeb01 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:48.046437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-10d4921e-d8bb-4b51-8fa7-90e9c39aeb01 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1508 microversion: 2.1 time: 0.143003 Aug 19 09:19:48.046994 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 231/451] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:47 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1508 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:48.063474 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-185d6c39-af12-4781-bd85-a7b102aa5787 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5ebad92-1098-4f19-8e0e-ab3a06d386ac"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:48.064611 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-185d6c39-af12-4781-bd85-a7b102aa5787 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:48.071516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-185d6c39-af12-4781-bd85-a7b102aa5787 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.072145 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-185d6c39-af12-4781-bd85-a7b102aa5787 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.072912 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-185d6c39-af12-4781-bd85-a7b102aa5787 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.073346 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-185d6c39-af12-4781-bd85-a7b102aa5787 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.155356 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-185d6c39-af12-4781-bd85-a7b102aa5787 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] HTTP exception thrown: Invalid volume: volume e5ebad92-1098-4f19-8e0e-ab3a06d386ac is already attached to instances: 728c5e2b-27f2-4879-b35b-7b814e6dca52 Aug 19 09:19:48.155959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-185d6c39-af12-4781-bd85-a7b102aa5787 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Returning 400 to user: Invalid volume: volume e5ebad92-1098-4f19-8e0e-ab3a06d386ac is already attached to instances: 728c5e2b-27f2-4879-b35b-7b814e6dca52 {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:19:48.156800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-185d6c39-af12-4781-bd85-a7b102aa5787 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "POST /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097497 Aug 19 09:19:48.157417 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 221/452] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:19:48 2021] POST /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 09:19:48.197057 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4a1147ca-c40b-475f-a07e-d333837e197c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:48.197666 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4a1147ca-c40b-475f-a07e-d333837e197c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:48.203573 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4a1147ca-c40b-475f-a07e-d333837e197c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.204020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4a1147ca-c40b-475f-a07e-d333837e197c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.204783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4a1147ca-c40b-475f-a07e-d333837e197c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.205217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4a1147ca-c40b-475f-a07e-d333837e197c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.221437 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ec6c917b-43c3-43c1-9a8d-0a963b0f1f83 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:48.221950 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ec6c917b-43c3-43c1-9a8d-0a963b0f1f83 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:48.228371 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ec6c917b-43c3-43c1-9a8d-0a963b0f1f83 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.228807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ec6c917b-43c3-43c1-9a8d-0a963b0f1f83 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.229596 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ec6c917b-43c3-43c1-9a8d-0a963b0f1f83 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.230051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ec6c917b-43c3-43c1-9a8d-0a963b0f1f83 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.326786 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4a1147ca-c40b-475f-a07e-d333837e197c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:48.334291 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4a1147ca-c40b-475f-a07e-d333837e197c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.140808 Aug 19 09:19:48.334852 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 232/453] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:48 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:48.356844 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-ec6c917b-43c3-43c1-9a8d-0a963b0f1f83 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lazy-loading 'services' on Instance uuid 728c5e2b-27f2-4879-b35b-7b814e6dca52 {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:19:48.366082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5aec0438-1b11-46ab-ad28-e4c84d1debd2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:48.366692 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5aec0438-1b11-46ab-ad28-e4c84d1debd2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:48.372441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5aec0438-1b11-46ab-ad28-e4c84d1debd2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.372895 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5aec0438-1b11-46ab-ad28-e4c84d1debd2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.373666 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5aec0438-1b11-46ab-ad28-e4c84d1debd2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.374107 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5aec0438-1b11-46ab-ad28-e4c84d1debd2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.466176 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ec6c917b-43c3-43c1-9a8d-0a963b0f1f83 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "DELETE /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments/e5ebad92-1098-4f19-8e0e-ab3a06d386ac" status: 202 len: 0 microversion: 2.1 time: 0.248521 Aug 19 09:19:48.466838 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 222/454] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:19:48 2021] DELETE /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments/e5ebad92-1098-4f19-8e0e-ab3a06d386ac => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:48.476489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-69ca4592-31ce-42e3-80a2-a1d765f20636 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:48.477666 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-69ca4592-31ce-42e3-80a2-a1d765f20636 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:48.483754 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-69ca4592-31ce-42e3-80a2-a1d765f20636 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.484231 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-69ca4592-31ce-42e3-80a2-a1d765f20636 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.485093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-69ca4592-31ce-42e3-80a2-a1d765f20636 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.485581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-69ca4592-31ce-42e3-80a2-a1d765f20636 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.504193 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5aec0438-1b11-46ab-ad28-e4c84d1debd2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:48.511301 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5aec0438-1b11-46ab-ad28-e4c84d1debd2 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1504 microversion: 2.1 time: 0.149337 Aug 19 09:19:48.512052 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 233/455] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:48 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:48.517900 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-69ca4592-31ce-42e3-80a2-a1d765f20636 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046719 Aug 19 09:19:48.518957 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 223/456] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:48 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:19:48.767593 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2add3d14-cd63-4e6d-9834-48174a5b538c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:48.769407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2add3d14-cd63-4e6d-9834-48174a5b538c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:48.775129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2add3d14-cd63-4e6d-9834-48174a5b538c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.775618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2add3d14-cd63-4e6d-9834-48174a5b538c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.776375 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2add3d14-cd63-4e6d-9834-48174a5b538c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:48.776805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2add3d14-cd63-4e6d-9834-48174a5b538c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:48.974795 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2add3d14-cd63-4e6d-9834-48174a5b538c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.210426 Aug 19 09:19:48.975633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 234/457] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:48 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:49.352162 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-67bc5ab5-3a68-455d-88e7-44d2cf50835c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:49.352791 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-67bc5ab5-3a68-455d-88e7-44d2cf50835c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:49.359446 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67bc5ab5-3a68-455d-88e7-44d2cf50835c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:49.360140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67bc5ab5-3a68-455d-88e7-44d2cf50835c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:49.360916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67bc5ab5-3a68-455d-88e7-44d2cf50835c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:49.361349 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67bc5ab5-3a68-455d-88e7-44d2cf50835c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:49.530658 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-67bc5ab5-3a68-455d-88e7-44d2cf50835c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:49.532721 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-98c56127-b25c-45b3-a468-d1aa3a4ef1b3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:49.534233 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-98c56127-b25c-45b3-a468-d1aa3a4ef1b3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:49.540733 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-67bc5ab5-3a68-455d-88e7-44d2cf50835c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.193314 Aug 19 09:19:49.541705 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 224/458] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:49 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:49.546394 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0c07ca00-9e93-4cb7-83fb-265b0007f3ec tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:49.547005 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0c07ca00-9e93-4cb7-83fb-265b0007f3ec tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:49.548761 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98c56127-b25c-45b3-a468-d1aa3a4ef1b3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:49.549998 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98c56127-b25c-45b3-a468-d1aa3a4ef1b3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:49.550901 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98c56127-b25c-45b3-a468-d1aa3a4ef1b3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:49.551594 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98c56127-b25c-45b3-a468-d1aa3a4ef1b3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:49.559852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0c07ca00-9e93-4cb7-83fb-265b0007f3ec tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:49.560307 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0c07ca00-9e93-4cb7-83fb-265b0007f3ec tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:49.561088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0c07ca00-9e93-4cb7-83fb-265b0007f3ec tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:49.561526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0c07ca00-9e93-4cb7-83fb-265b0007f3ec tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:49.588747 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-98c56127-b25c-45b3-a468-d1aa3a4ef1b3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061833 Aug 19 09:19:49.589452 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 235/459] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:49 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:49.779154 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0c07ca00-9e93-4cb7-83fb-265b0007f3ec tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:49.789679 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0c07ca00-9e93-4cb7-83fb-265b0007f3ec tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1504 microversion: 2.1 time: 0.246808 Aug 19 09:19:49.790543 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 225/460] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:49 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:49.991002 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4d8ebad1-5e62-4d36-b28f-b0cca3f0a57e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:49.992827 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4d8ebad1-5e62-4d36-b28f-b0cca3f0a57e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:49.999586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4d8ebad1-5e62-4d36-b28f-b0cca3f0a57e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:50.000017 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4d8ebad1-5e62-4d36-b28f-b0cca3f0a57e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:50.001065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4d8ebad1-5e62-4d36-b28f-b0cca3f0a57e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:50.002791 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4d8ebad1-5e62-4d36-b28f-b0cca3f0a57e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:50.073323 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-91bbce15-1043-4d99-8554-b334a0a5b6de req-a8adad20-07f5-4820-9982-9abac623559a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc32e0f-09c3-46d7-a9d5-a44a3e48f222", "name": "network-vif-deleted", "tag": "86c16351-fe7e-4beb-81f6-d02028ab6940"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:50.074894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:19:50.074894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:19:50.081487 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-91bbce15-1043-4d99-8554-b334a0a5b6de req-a8adad20-07f5-4820-9982-9abac623559a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:50.081922 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-91bbce15-1043-4d99-8554-b334a0a5b6de req-a8adad20-07f5-4820-9982-9abac623559a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:50.094787 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-91bbce15-1043-4d99-8554-b334a0a5b6de req-a8adad20-07f5-4820-9982-9abac623559a service nova] Creating event network-vif-deleted:86c16351-fe7e-4beb-81f6-d02028ab6940 for instance 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 on hv-cinder-77387 Aug 19 09:19:50.099844 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-91bbce15-1043-4d99-8554-b334a0a5b6de req-a8adad20-07f5-4820-9982-9abac623559a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029996 Aug 19 09:19:50.100410 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 226/461] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:19:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:19:50.561160 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4dbc9108-ee15-4523-be99-e4ac2ca66fd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:50.562044 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4dbc9108-ee15-4523-be99-e4ac2ca66fd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:50.568612 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4dbc9108-ee15-4523-be99-e4ac2ca66fd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:50.569058 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4dbc9108-ee15-4523-be99-e4ac2ca66fd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:50.569827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4dbc9108-ee15-4523-be99-e4ac2ca66fd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:50.573092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4dbc9108-ee15-4523-be99-e4ac2ca66fd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:50.696835 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4dbc9108-ee15-4523-be99-e4ac2ca66fd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:50.704364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4dbc9108-ee15-4523-be99-e4ac2ca66fd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.147088 Aug 19 09:19:50.713815 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 227/462] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:50 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:50.713815 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-891c478e-ebb2-4161-9235-7195944b7fdd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:50.713815 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-891c478e-ebb2-4161-9235-7195944b7fdd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:50.716530 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-891c478e-ebb2-4161-9235-7195944b7fdd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:50.717078 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-891c478e-ebb2-4161-9235-7195944b7fdd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:50.717841 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-891c478e-ebb2-4161-9235-7195944b7fdd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:50.718338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-891c478e-ebb2-4161-9235-7195944b7fdd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:50.750050 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-891c478e-ebb2-4161-9235-7195944b7fdd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044057 Aug 19 09:19:50.750761 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 228/463] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:50 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:50.763575 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4d8ebad1-5e62-4d36-b28f-b0cca3f0a57e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.781091 Aug 19 09:19:50.764403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 236/464] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:49 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:50.807475 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:50.808289 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:50.818580 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:50.819020 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:50.819857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:50.820507 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:50.852553 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:50.852991 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:50.853432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lazy-loading 'fault' on Instance uuid 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:19:50.899369 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:50.909891 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-dd6b81ff-9888-46be-a918-74892a829a86 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1304 microversion: 2.1 time: 0.103189 Aug 19 09:19:50.909891 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 229/465] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:50 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:51.722034 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d5a4d979-6542-48ac-90db-ea98f7938a9e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:51.722720 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d5a4d979-6542-48ac-90db-ea98f7938a9e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:51.729333 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5a4d979-6542-48ac-90db-ea98f7938a9e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:51.729774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5a4d979-6542-48ac-90db-ea98f7938a9e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:51.730529 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5a4d979-6542-48ac-90db-ea98f7938a9e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:51.730955 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5a4d979-6542-48ac-90db-ea98f7938a9e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:51.761400 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9ab82286-7fdd-4570-abb8-727f012edf44 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:51.762307 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9ab82286-7fdd-4570-abb8-727f012edf44 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:51.773332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ab82286-7fdd-4570-abb8-727f012edf44 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:51.773772 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ab82286-7fdd-4570-abb8-727f012edf44 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:51.774550 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ab82286-7fdd-4570-abb8-727f012edf44 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:51.774980 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ab82286-7fdd-4570-abb8-727f012edf44 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:51.804641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9ab82286-7fdd-4570-abb8-727f012edf44 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046929 Aug 19 09:19:51.805233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 230/466] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:51 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:19:51.809556 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-53a4a74f-da4c-494b-9ff5-55bde077e702 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:51.810445 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-53a4a74f-da4c-494b-9ff5-55bde077e702 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:51.815997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-53a4a74f-da4c-494b-9ff5-55bde077e702 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:51.816519 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-53a4a74f-da4c-494b-9ff5-55bde077e702 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:51.817279 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-53a4a74f-da4c-494b-9ff5-55bde077e702 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:51.817751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-53a4a74f-da4c-494b-9ff5-55bde077e702 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:51.853890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d5a4d979-6542-48ac-90db-ea98f7938a9e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:51.861011 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d5a4d979-6542-48ac-90db-ea98f7938a9e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.143545 Aug 19 09:19:51.861626 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 237/467] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:51 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:51.922544 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:51.923157 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:51.928869 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:51.929316 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:51.930073 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:51.930510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:51.960312 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:51.960756 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:51.961195 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lazy-loading 'fault' on Instance uuid 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:19:52.002608 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:52.009782 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-638e31b1-5443-4f93-a3b2-6a64dc31bb8c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1304 microversion: 2.1 time: 0.090763 Aug 19 09:19:52.010332 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 238/468] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:51 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:52.816671 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f3b445b0-b198-40d8-bf9f-a77253ffed3d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:52.817513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f3b445b0-b198-40d8-bf9f-a77253ffed3d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:52.825310 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3b445b0-b198-40d8-bf9f-a77253ffed3d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:52.825753 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3b445b0-b198-40d8-bf9f-a77253ffed3d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:52.826506 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3b445b0-b198-40d8-bf9f-a77253ffed3d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:52.826931 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f3b445b0-b198-40d8-bf9f-a77253ffed3d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:52.855683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f3b445b0-b198-40d8-bf9f-a77253ffed3d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043461 Aug 19 09:19:52.856231 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 239/469] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:52 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:19:52.876738 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-202f0329-b6ea-4930-80b0-c807c2499503 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:52.877958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-202f0329-b6ea-4930-80b0-c807c2499503 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:52.883320 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-202f0329-b6ea-4930-80b0-c807c2499503 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:52.883767 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-202f0329-b6ea-4930-80b0-c807c2499503 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:52.884513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-202f0329-b6ea-4930-80b0-c807c2499503 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:52.884935 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-202f0329-b6ea-4930-80b0-c807c2499503 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:53.005554 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-202f0329-b6ea-4930-80b0-c807c2499503 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:53.012646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-202f0329-b6ea-4930-80b0-c807c2499503 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.139091 Aug 19 09:19:53.013199 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 240/470] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:52 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:53.027053 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:53.027675 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:53.033581 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:53.034001 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:53.034757 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:53.035189 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:53.066269 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:53.066758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:53.067144 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lazy-loading 'fault' on Instance uuid 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:19:53.106142 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:53.114038 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ef76afad-da22-44f3-87be-8e82cbfd2b1b tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1304 microversion: 2.1 time: 0.090487 Aug 19 09:19:53.114575 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 241/471] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:53 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:53.866882 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cdaabb1a-ead2-46f9-93b0-28d4ef0bf582 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:53.867827 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cdaabb1a-ead2-46f9-93b0-28d4ef0bf582 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:53.873679 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cdaabb1a-ead2-46f9-93b0-28d4ef0bf582 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:53.874114 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cdaabb1a-ead2-46f9-93b0-28d4ef0bf582 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:53.874879 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cdaabb1a-ead2-46f9-93b0-28d4ef0bf582 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:53.875339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cdaabb1a-ead2-46f9-93b0-28d4ef0bf582 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:53.904415 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cdaabb1a-ead2-46f9-93b0-28d4ef0bf582 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041260 Aug 19 09:19:53.904945 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 242/472] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:53 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:19:54.029756 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e30a3142-1a24-496b-a329-b855288a63b0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:54.030365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e30a3142-1a24-496b-a329-b855288a63b0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:54.037177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e30a3142-1a24-496b-a329-b855288a63b0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:54.037619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e30a3142-1a24-496b-a329-b855288a63b0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:54.038445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e30a3142-1a24-496b-a329-b855288a63b0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:54.038841 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e30a3142-1a24-496b-a329-b855288a63b0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:54.156034 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e30a3142-1a24-496b-a329-b855288a63b0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:54.163804 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e30a3142-1a24-496b-a329-b855288a63b0 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.137690 Aug 19 09:19:54.164434 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 243/473] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:54 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:54.168495 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:54.169087 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:54.174339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:54.174773 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:54.175552 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:54.175977 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:54.205842 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:54.206303 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:54.206735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lazy-loading 'fault' on Instance uuid 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:19:54.244082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:54.250969 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d3125609-4f00-47fa-bc4e-7ee9a866e1a0 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1304 microversion: 2.1 time: 0.085592 Aug 19 09:19:54.251555 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 244/474] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:54 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:54.725722 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-53a4a74f-da4c-494b-9ff5-55bde077e702 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 2.919236 Aug 19 09:19:54.726350 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 231/475] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:51 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 2921 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:54.915594 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-859a5f10-acd5-4097-9269-c08f3b2796e5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:54.916505 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-859a5f10-acd5-4097-9269-c08f3b2796e5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:54.922610 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-859a5f10-acd5-4097-9269-c08f3b2796e5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:54.923050 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-859a5f10-acd5-4097-9269-c08f3b2796e5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:54.923838 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-859a5f10-acd5-4097-9269-c08f3b2796e5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:54.924839 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-859a5f10-acd5-4097-9269-c08f3b2796e5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:54.952603 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-859a5f10-acd5-4097-9269-c08f3b2796e5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040731 Aug 19 09:19:54.953130 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 245/476] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:54 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:55.181517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9de0a200-79bb-4c39-b935-d7385a4f60db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:55.182247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9de0a200-79bb-4c39-b935-d7385a4f60db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:55.188563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9de0a200-79bb-4c39-b935-d7385a4f60db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:55.189007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9de0a200-79bb-4c39-b935-d7385a4f60db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:55.189851 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9de0a200-79bb-4c39-b935-d7385a4f60db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:55.190365 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9de0a200-79bb-4c39-b935-d7385a4f60db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:55.268177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:55.268816 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:55.274503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:55.274943 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:55.275738 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:55.276166 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:55.308380 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:55.308826 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:55.309273 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lazy-loading 'fault' on Instance uuid 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:19:55.315175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9de0a200-79bb-4c39-b935-d7385a4f60db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:55.322420 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9de0a200-79bb-4c39-b935-d7385a4f60db tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.144914 Aug 19 09:19:55.323061 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 232/477] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:55 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:55.353530 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:55.361570 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-dcab7d6a-15f1-44a0-94ec-d44cc112a316 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 200 len: 1304 microversion: 2.1 time: 0.097019 Aug 19 09:19:55.362122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 246/478] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:55 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:55.737308 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bc99c3e1-440c-4424-9a24-bc450e2679ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:55.738222 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bc99c3e1-440c-4424-9a24-bc450e2679ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:55.743999 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bc99c3e1-440c-4424-9a24-bc450e2679ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:55.744456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bc99c3e1-440c-4424-9a24-bc450e2679ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:55.745213 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bc99c3e1-440c-4424-9a24-bc450e2679ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:55.745639 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bc99c3e1-440c-4424-9a24-bc450e2679ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:55.911839 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bc99c3e1-440c-4424-9a24-bc450e2679ca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.178085 Aug 19 09:19:55.912631 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 233/479] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:55 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:55.963583 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-48f49a5e-4451-4915-995e-863ceb2493d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:55.964556 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-48f49a5e-4451-4915-995e-863ceb2493d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:55.970243 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-48f49a5e-4451-4915-995e-863ceb2493d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:55.970720 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-48f49a5e-4451-4915-995e-863ceb2493d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:55.972222 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-48f49a5e-4451-4915-995e-863ceb2493d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:55.972752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-48f49a5e-4451-4915-995e-863ceb2493d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:56.001843 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-48f49a5e-4451-4915-995e-863ceb2493d2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041893 Aug 19 09:19:56.005930 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 247/480] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:55 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:56.340148 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c157dcf8-1282-4db5-87c2-6da0f9588cdb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:56.340842 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c157dcf8-1282-4db5-87c2-6da0f9588cdb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:56.347567 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c157dcf8-1282-4db5-87c2-6da0f9588cdb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:56.348085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c157dcf8-1282-4db5-87c2-6da0f9588cdb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:56.349189 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c157dcf8-1282-4db5-87c2-6da0f9588cdb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:56.349625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c157dcf8-1282-4db5-87c2-6da0f9588cdb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:56.388051 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-03c3158f-8e48-46cd-9dff-ef88b38ddb18 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:56.389080 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-03c3158f-8e48-46cd-9dff-ef88b38ddb18 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:56.396925 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03c3158f-8e48-46cd-9dff-ef88b38ddb18 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:56.397605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03c3158f-8e48-46cd-9dff-ef88b38ddb18 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:56.398605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03c3158f-8e48-46cd-9dff-ef88b38ddb18 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:56.399132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03c3158f-8e48-46cd-9dff-ef88b38ddb18 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:56.414947 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-03c3158f-8e48-46cd-9dff-ef88b38ddb18 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] HTTP exception thrown: Instance 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 could not be found. Aug 19 09:19:56.415612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-03c3158f-8e48-46cd-9dff-ef88b38ddb18 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Returning 404 to user: Instance 7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:19:56.416513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-03c3158f-8e48-46cd-9dff-ef88b38ddb18 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222" status: 404 len: 111 microversion: 2.1 time: 0.042518 Aug 19 09:19:56.417239 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 248/481] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:56 2021] GET /compute/v2.1/servers/7dc32e0f-09c3-46d7-a9d5-a44a3e48f222 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 09:19:56.505295 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c157dcf8-1282-4db5-87c2-6da0f9588cdb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:56.512940 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c157dcf8-1282-4db5-87c2-6da0f9588cdb tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.176666 Aug 19 09:19:56.513730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 234/482] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:56 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:56.522854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1853185074", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "networks": [{"uuid": "91d9aee0-6921-4c01-95c7-a746e497353e"}]}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:56.574246 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.network.neutron [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] validate_networks() for [('91d9aee0-6921-4c01-95c7-a746e497353e', None, None, None, None, None)] {{(pid=107957) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:19:56.918854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Flavor limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:19:56.919292 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Image limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:19:56.919876 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Flavor pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:19:56.920292 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Image pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:19:56.920707 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:19:56.923521 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d919bb80-0c96-408f-9171-d47b52ed157a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:56.924463 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d919bb80-0c96-408f-9171-d47b52ed157a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:56.929800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:56.930139 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d919bb80-0c96-408f-9171-d47b52ed157a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:56.930245 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:56.930535 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d919bb80-0c96-408f-9171-d47b52ed157a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:56.931038 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:56.931311 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d919bb80-0c96-408f-9171-d47b52ed157a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:56.931516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:56.931753 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d919bb80-0c96-408f-9171-d47b52ed157a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:56.948391 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Getting quotas for project ca3fe8da8a104ba2b3e206211030cffb. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:19:56.952263 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Getting quotas for user 0ea096a506eb45af9559d4ccc9698673 and project ca3fe8da8a104ba2b3e206211030cffb. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:19:56.964323 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Going to run 1 instances... {{(pid=107957) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:19:56.966647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:19:57.009185 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c203a848-fd8b-47d4-9ac5-9c7c2540b510 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489952 Aug 19 09:19:57.009810 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 249/483] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:19:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 09:19:57.009810 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-254efb3f-47fa-43e5-9dc0-5416aa2bb00a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:57.015073 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-254efb3f-47fa-43e5-9dc0-5416aa2bb00a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:57.022004 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-254efb3f-47fa-43e5-9dc0-5416aa2bb00a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:57.022454 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-254efb3f-47fa-43e5-9dc0-5416aa2bb00a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:57.023229 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-254efb3f-47fa-43e5-9dc0-5416aa2bb00a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:57.023696 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-254efb3f-47fa-43e5-9dc0-5416aa2bb00a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:57.053478 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-254efb3f-47fa-43e5-9dc0-5416aa2bb00a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042663 Aug 19 09:19:57.054015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 250/484] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:57 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:57.058096 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2dcb8c8b-aa66-438a-9074-d4a28782235a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:57.058699 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2dcb8c8b-aa66-438a-9074-d4a28782235a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:57.107685 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d919bb80-0c96-408f-9171-d47b52ed157a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.187551 Aug 19 09:19:57.108723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 235/485] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:56 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:57.111084 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2dcb8c8b-aa66-438a-9074-d4a28782235a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:57.117769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2dcb8c8b-aa66-438a-9074-d4a28782235a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1214 microversion: 2.1 time: 0.062790 Aug 19 09:19:57.118323 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 251/486] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:57 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:57.530094 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-77d5f96c-be08-4fd6-99fb-30250c819398 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:57.530788 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-77d5f96c-be08-4fd6-99fb-30250c819398 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:57.538011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-77d5f96c-be08-4fd6-99fb-30250c819398 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:57.538468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-77d5f96c-be08-4fd6-99fb-30250c819398 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:57.539248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-77d5f96c-be08-4fd6-99fb-30250c819398 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:57.539792 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-77d5f96c-be08-4fd6-99fb-30250c819398 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:57.662019 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-77d5f96c-be08-4fd6-99fb-30250c819398 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:57.669123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-77d5f96c-be08-4fd6-99fb-30250c819398 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1503 microversion: 2.1 time: 0.142995 Aug 19 09:19:57.669682 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 236/487] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:57 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1503 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:57.685441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9d931c10-04a4-4932-a2e5-b82f880ff93c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2c3a27b-b5ec-4557-8708-b2acdfdf058a"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:57.686485 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9d931c10-04a4-4932-a2e5-b82f880ff93c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:57.692525 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9d931c10-04a4-4932-a2e5-b82f880ff93c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:57.692963 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9d931c10-04a4-4932-a2e5-b82f880ff93c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:57.693715 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9d931c10-04a4-4932-a2e5-b82f880ff93c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:57.694139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9d931c10-04a4-4932-a2e5-b82f880ff93c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:57.718148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-9d931c10-04a4-4932-a2e5-b82f880ff93c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] HTTP exception thrown: Cannot 'attach_volume' instance f4c3bc8f-45ae-4a40-8a3d-d9642d8728df while it is in vm_state rescued Aug 19 09:19:57.718654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9d931c10-04a4-4932-a2e5-b82f880ff93c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Returning 409 to user: Cannot 'attach_volume' instance f4c3bc8f-45ae-4a40-8a3d-d9642d8728df while it is in vm_state rescued {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:19:57.719475 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9d931c10-04a4-4932-a2e5-b82f880ff93c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037995 Aug 19 09:19:57.719990 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 252/488] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:19:57 2021] POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 19 09:19:57.729028 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-537f30a5-921f-4275-962f-b14e8743603e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:57.729549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-537f30a5-921f-4275-962f-b14e8743603e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:57.735522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-537f30a5-921f-4275-962f-b14e8743603e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:57.735979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-537f30a5-921f-4275-962f-b14e8743603e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:57.736826 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-537f30a5-921f-4275-962f-b14e8743603e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:57.737267 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-537f30a5-921f-4275-962f-b14e8743603e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:57.806786 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-537f30a5-921f-4275-962f-b14e8743603e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/action" status: 202 len: 0 microversion: 2.1 time: 0.081161 Aug 19 09:19:57.810544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 237/489] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:19:57 2021] POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:57.815562 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-38500058-c79b-4a4e-886a-81ff4baea0f5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:57.816159 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-38500058-c79b-4a4e-886a-81ff4baea0f5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:57.822097 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38500058-c79b-4a4e-886a-81ff4baea0f5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:57.822512 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38500058-c79b-4a4e-886a-81ff4baea0f5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:57.823316 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38500058-c79b-4a4e-886a-81ff4baea0f5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:57.823927 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38500058-c79b-4a4e-886a-81ff4baea0f5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:57.945360 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-38500058-c79b-4a4e-886a-81ff4baea0f5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:57.952861 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-38500058-c79b-4a4e-886a-81ff4baea0f5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.141000 Aug 19 09:19:57.953419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 253/490] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:57 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:58.066534 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6111a086-3e51-45f8-b438-e2011d6a2100 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:58.067740 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6111a086-3e51-45f8-b438-e2011d6a2100 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:58.073819 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6111a086-3e51-45f8-b438-e2011d6a2100 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:58.074267 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6111a086-3e51-45f8-b438-e2011d6a2100 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:58.075038 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6111a086-3e51-45f8-b438-e2011d6a2100 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:58.075498 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6111a086-3e51-45f8-b438-e2011d6a2100 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:58.105927 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6111a086-3e51-45f8-b438-e2011d6a2100 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Aug 19 09:19:58.106476 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 238/491] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:58 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:58.119064 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ca1fc90b-c7f7-47de-8366-a68baf4f9401 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:58.120038 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ca1fc90b-c7f7-47de-8366-a68baf4f9401 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:58.125772 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca1fc90b-c7f7-47de-8366-a68baf4f9401 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:58.126213 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca1fc90b-c7f7-47de-8366-a68baf4f9401 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:58.127604 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca1fc90b-c7f7-47de-8366-a68baf4f9401 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:58.128037 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca1fc90b-c7f7-47de-8366-a68baf4f9401 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:58.134058 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8a8d675f-81b8-4713-8a4c-61804412e040 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:58.135084 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8a8d675f-81b8-4713-8a4c-61804412e040 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:58.141869 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8a8d675f-81b8-4713-8a4c-61804412e040 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:58.142434 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8a8d675f-81b8-4713-8a4c-61804412e040 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:58.143909 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8a8d675f-81b8-4713-8a4c-61804412e040 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:58.144406 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8a8d675f-81b8-4713-8a4c-61804412e040 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:58.239252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ca1fc90b-c7f7-47de-8366-a68baf4f9401 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.123794 Aug 19 09:19:58.240301 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 254/492] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:58 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:19:58.248480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8a8d675f-81b8-4713-8a4c-61804412e040 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:58.256821 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8a8d675f-81b8-4713-8a4c-61804412e040 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1274 microversion: 2.1 time: 0.126370 Aug 19 09:19:58.267115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 239/493] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:58 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:58.971035 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3a52b93a-b208-4855-a93f-63ed5af26b21 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:58.971799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3a52b93a-b208-4855-a93f-63ed5af26b21 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:58.978929 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a52b93a-b208-4855-a93f-63ed5af26b21 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:58.979522 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a52b93a-b208-4855-a93f-63ed5af26b21 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:58.980365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a52b93a-b208-4855-a93f-63ed5af26b21 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:58.980874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a52b93a-b208-4855-a93f-63ed5af26b21 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:59.116850 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3a52b93a-b208-4855-a93f-63ed5af26b21 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:59.121960 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3d578f80-e03a-4619-965f-c0f39f1e2caa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:59.123763 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3d578f80-e03a-4619-965f-c0f39f1e2caa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:59.125034 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3a52b93a-b208-4855-a93f-63ed5af26b21 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.158161 Aug 19 09:19:59.126192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 255/494] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:58 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:19:59.137805 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3d578f80-e03a-4619-965f-c0f39f1e2caa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:59.138530 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3d578f80-e03a-4619-965f-c0f39f1e2caa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:59.139309 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3d578f80-e03a-4619-965f-c0f39f1e2caa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:59.139777 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3d578f80-e03a-4619-965f-c0f39f1e2caa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:59.175686 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3d578f80-e03a-4619-965f-c0f39f1e2caa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061358 Aug 19 09:19:59.176954 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 240/495] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:19:59 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:19:59.253923 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ea75bc90-b20f-4183-afca-c710591b846a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:59.255479 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ea75bc90-b20f-4183-afca-c710591b846a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:59.265844 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea75bc90-b20f-4183-afca-c710591b846a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:59.266304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea75bc90-b20f-4183-afca-c710591b846a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:59.267106 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea75bc90-b20f-4183-afca-c710591b846a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:59.268069 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea75bc90-b20f-4183-afca-c710591b846a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:59.275703 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a1013ddf-f3d8-4619-9f10-777ae67cbb63 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:19:59.276852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a1013ddf-f3d8-4619-9f10-777ae67cbb63 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:19:59.284052 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a1013ddf-f3d8-4619-9f10-777ae67cbb63 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:59.284735 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a1013ddf-f3d8-4619-9f10-777ae67cbb63 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:59.285670 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a1013ddf-f3d8-4619-9f10-777ae67cbb63 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:59.286097 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a1013ddf-f3d8-4619-9f10-777ae67cbb63 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:59.544201 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a1013ddf-f3d8-4619-9f10-777ae67cbb63 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:19:59.551670 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a1013ddf-f3d8-4619-9f10-777ae67cbb63 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.280941 Aug 19 09:19:59.552247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 241/496] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:19:59 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:19:59.701288 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ea75bc90-b20f-4183-afca-c710591b846a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28133 microversion: 2.20 time: 0.453871 Aug 19 09:19:59.702977 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 256/497] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:19:59 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28133 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:19:59.893556 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-7c167afc-2310-411f-be47-6e3f14204964 req-2d061836-2c20-435f-b3c4-24bff95cb0ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c850e5cb-c98e-487b-941e-5e12784e18aa", "tag": "b2bc4996-8e90-4c79-9ed8-262730602376"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:19:59.896338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:19:59.896338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:19:59.905816 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-7c167afc-2310-411f-be47-6e3f14204964 req-2d061836-2c20-435f-b3c4-24bff95cb0ea service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:19:59.906358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-7c167afc-2310-411f-be47-6e3f14204964 req-2d061836-2c20-435f-b3c4-24bff95cb0ea service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:19:59.925068 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-7c167afc-2310-411f-be47-6e3f14204964 req-2d061836-2c20-435f-b3c4-24bff95cb0ea service nova] Creating event network-changed:b2bc4996-8e90-4c79-9ed8-262730602376 for instance c850e5cb-c98e-487b-941e-5e12784e18aa on hv-cinder-77387 Aug 19 09:19:59.930663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-7c167afc-2310-411f-be47-6e3f14204964 req-2d061836-2c20-435f-b3c4-24bff95cb0ea service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048096 Aug 19 09:19:59.931219 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 242/498] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:19:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:20:00.143833 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8176f0d2-00a3-4129-bda6-6883f1ea125d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:00.144546 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8176f0d2-00a3-4129-bda6-6883f1ea125d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:00.151571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8176f0d2-00a3-4129-bda6-6883f1ea125d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:00.152026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8176f0d2-00a3-4129-bda6-6883f1ea125d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:00.152799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8176f0d2-00a3-4129-bda6-6883f1ea125d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:00.153232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8176f0d2-00a3-4129-bda6-6883f1ea125d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:00.187871 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-25c90cc1-ef87-4b6d-b9b1-c89c03804861 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:00.189135 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-25c90cc1-ef87-4b6d-b9b1-c89c03804861 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:00.195494 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-25c90cc1-ef87-4b6d-b9b1-c89c03804861 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:00.196053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-25c90cc1-ef87-4b6d-b9b1-c89c03804861 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:00.196908 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-25c90cc1-ef87-4b6d-b9b1-c89c03804861 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:00.197422 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-25c90cc1-ef87-4b6d-b9b1-c89c03804861 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:00.227832 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-25c90cc1-ef87-4b6d-b9b1-c89c03804861 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043970 Aug 19 09:20:00.228512 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 243/499] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:20:00 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 19 09:20:00.288437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8176f0d2-00a3-4129-bda6-6883f1ea125d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:00.296029 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8176f0d2-00a3-4129-bda6-6883f1ea125d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.156132 Aug 19 09:20:00.306477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 257/500] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:00 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:00.395327 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-821812855", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "networks": [{"uuid": "5e78b5e6-6e38-4b51-a3a6-7fec0d074363"}]}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:00.446733 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] validate_networks() for [('5e78b5e6-6e38-4b51-a3a6-7fec0d074363', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:20:00.571093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5308ca48-92f9-4026-b8a9-f16bfbc662e1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:00.571723 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5308ca48-92f9-4026-b8a9-f16bfbc662e1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:00.577396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5308ca48-92f9-4026-b8a9-f16bfbc662e1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:00.577836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5308ca48-92f9-4026-b8a9-f16bfbc662e1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:00.578593 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5308ca48-92f9-4026-b8a9-f16bfbc662e1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:00.579022 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5308ca48-92f9-4026-b8a9-f16bfbc662e1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:00.704047 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5308ca48-92f9-4026-b8a9-f16bfbc662e1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:00.711860 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5308ca48-92f9-4026-b8a9-f16bfbc662e1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.144358 Aug 19 09:20:00.712539 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 258/501] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:00 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:00.716836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b0a9ed95-41c8-44d8-8482-c0ed48a907d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:00.717922 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b0a9ed95-41c8-44d8-8482-c0ed48a907d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:00.725051 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b0a9ed95-41c8-44d8-8482-c0ed48a907d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:00.725505 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b0a9ed95-41c8-44d8-8482-c0ed48a907d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:00.726314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b0a9ed95-41c8-44d8-8482-c0ed48a907d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:00.726751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b0a9ed95-41c8-44d8-8482-c0ed48a907d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:01.046450 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:20:01.046875 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:20:01.047402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:20:01.047816 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:20:01.048229 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:20:01.057929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:01.058451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:01.059533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:01.060026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:01.078970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Getting quotas for project 8bd62739089241319075c92d0306a0a3. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:20:01.091306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Getting quotas for user bfa387ffa6784561956f39df611dfab4 and project 8bd62739089241319075c92d0306a0a3. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:20:01.095683 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:20:01.098012 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:20:01.145186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-555570c8-9d46-4454-ad3f-8991403f946a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753494 Aug 19 09:20:01.150928 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 244/502] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:20:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:20:01.155293 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-945ca114-ca99-4331-a284-4a256c9d3aaa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:01.155924 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-945ca114-ca99-4331-a284-4a256c9d3aaa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:01.212825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-945ca114-ca99-4331-a284-4a256c9d3aaa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:01.220249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-945ca114-ca99-4331-a284-4a256c9d3aaa tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1217 microversion: 2.1 time: 0.068360 Aug 19 09:20:01.221117 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 245/503] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:01 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:01.313561 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-281befee-481b-4f6f-9c8f-c14b222bef23 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:01.314161 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-281befee-481b-4f6f-9c8f-c14b222bef23 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:01.320473 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-281befee-481b-4f6f-9c8f-c14b222bef23 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:01.320920 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-281befee-481b-4f6f-9c8f-c14b222bef23 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:01.321676 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-281befee-481b-4f6f-9c8f-c14b222bef23 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:01.322103 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-281befee-481b-4f6f-9c8f-c14b222bef23 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:01.465686 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-281befee-481b-4f6f-9c8f-c14b222bef23 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:01.474132 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-281befee-481b-4f6f-9c8f-c14b222bef23 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.163572 Aug 19 09:20:01.475291 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 246/504] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:01 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:01.552651 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b0a9ed95-41c8-44d8-8482-c0ed48a907d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28423 microversion: 2.20 time: 0.838974 Aug 19 09:20:01.553692 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 259/505] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:00 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28423 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:01.728863 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f494a4be-a314-4b5b-b978-8afaa2f93370 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:01.729497 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f494a4be-a314-4b5b-b978-8afaa2f93370 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:01.735101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f494a4be-a314-4b5b-b978-8afaa2f93370 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:01.735576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f494a4be-a314-4b5b-b978-8afaa2f93370 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:01.737026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f494a4be-a314-4b5b-b978-8afaa2f93370 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:01.737495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f494a4be-a314-4b5b-b978-8afaa2f93370 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:01.863051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f494a4be-a314-4b5b-b978-8afaa2f93370 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:01.870054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f494a4be-a314-4b5b-b978-8afaa2f93370 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.144832 Aug 19 09:20:01.870608 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 247/506] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:01 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:02.237950 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-041e3fab-6f3d-4694-8a11-9b51236d68bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:02.238640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-041e3fab-6f3d-4694-8a11-9b51236d68bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:02.245331 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-041e3fab-6f3d-4694-8a11-9b51236d68bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:02.245776 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-041e3fab-6f3d-4694-8a11-9b51236d68bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:02.246529 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-041e3fab-6f3d-4694-8a11-9b51236d68bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:02.246958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-041e3fab-6f3d-4694-8a11-9b51236d68bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:02.306615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-041e3fab-6f3d-4694-8a11-9b51236d68bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:02.313616 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-041e3fab-6f3d-4694-8a11-9b51236d68bb tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1269 microversion: 2.1 time: 0.079829 Aug 19 09:20:02.314158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 260/507] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:02 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1269 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:02.491779 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0cfcdec7-c29a-4ef9-8c03-a4d9308f417b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:02.492391 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0cfcdec7-c29a-4ef9-8c03-a4d9308f417b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:02.501151 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0cfcdec7-c29a-4ef9-8c03-a4d9308f417b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:02.501600 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0cfcdec7-c29a-4ef9-8c03-a4d9308f417b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:02.503020 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0cfcdec7-c29a-4ef9-8c03-a4d9308f417b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:02.503484 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0cfcdec7-c29a-4ef9-8c03-a4d9308f417b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:02.564954 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-10a801ff-1e5d-4657-85a2-a20280d24730 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:02.566425 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-10a801ff-1e5d-4657-85a2-a20280d24730 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:02.573072 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10a801ff-1e5d-4657-85a2-a20280d24730 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:02.573527 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10a801ff-1e5d-4657-85a2-a20280d24730 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:02.577570 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10a801ff-1e5d-4657-85a2-a20280d24730 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:02.578050 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10a801ff-1e5d-4657-85a2-a20280d24730 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:02.693330 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-10a801ff-1e5d-4657-85a2-a20280d24730 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28423 microversion: 2.20 time: 0.132452 Aug 19 09:20:02.694164 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 261/508] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:02 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28423 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:20:02.720868 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0cfcdec7-c29a-4ef9-8c03-a4d9308f417b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:02.728602 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0cfcdec7-c29a-4ef9-8c03-a4d9308f417b tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.240401 Aug 19 09:20:02.729147 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 248/509] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:02 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:02.888664 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e503af1b-21b3-4eae-a6f7-20bb8a46d78a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:02.889554 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e503af1b-21b3-4eae-a6f7-20bb8a46d78a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:02.896528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e503af1b-21b3-4eae-a6f7-20bb8a46d78a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:02.896973 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e503af1b-21b3-4eae-a6f7-20bb8a46d78a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:02.897747 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e503af1b-21b3-4eae-a6f7-20bb8a46d78a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:02.898176 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e503af1b-21b3-4eae-a6f7-20bb8a46d78a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:03.038612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e503af1b-21b3-4eae-a6f7-20bb8a46d78a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:03.046435 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e503af1b-21b3-4eae-a6f7-20bb8a46d78a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.162697 Aug 19 09:20:03.046982 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 262/510] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:02 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:03.330098 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-31c14710-a712-4b5f-95b0-dfae12f2d3d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:03.331864 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-31c14710-a712-4b5f-95b0-dfae12f2d3d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:03.337919 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-31c14710-a712-4b5f-95b0-dfae12f2d3d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:03.338366 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-31c14710-a712-4b5f-95b0-dfae12f2d3d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:03.339152 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-31c14710-a712-4b5f-95b0-dfae12f2d3d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:03.339609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-31c14710-a712-4b5f-95b0-dfae12f2d3d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:03.705879 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-00fed880-28be-49ae-86d1-9f8feb12c9c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:03.706946 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-00fed880-28be-49ae-86d1-9f8feb12c9c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:03.713395 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00fed880-28be-49ae-86d1-9f8feb12c9c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:03.713923 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00fed880-28be-49ae-86d1-9f8feb12c9c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:03.714777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00fed880-28be-49ae-86d1-9f8feb12c9c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:03.715348 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00fed880-28be-49ae-86d1-9f8feb12c9c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:03.779922 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-31c14710-a712-4b5f-95b0-dfae12f2d3d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:03.790093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-31c14710-a712-4b5f-95b0-dfae12f2d3d8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.463983 Aug 19 09:20:03.800671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 249/511] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:03 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:03.800671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5f4fbe9c-b9c6-473b-a428-5abbff94bd95 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:03.800671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5f4fbe9c-b9c6-473b-a428-5abbff94bd95 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:03.801869 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f4fbe9c-b9c6-473b-a428-5abbff94bd95 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:03.802451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f4fbe9c-b9c6-473b-a428-5abbff94bd95 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:03.803229 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f4fbe9c-b9c6-473b-a428-5abbff94bd95 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:03.803693 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5f4fbe9c-b9c6-473b-a428-5abbff94bd95 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:03.836456 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-00fed880-28be-49ae-86d1-9f8feb12c9c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28423 microversion: 2.20 time: 0.134885 Aug 19 09:20:03.837096 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 263/512] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:03 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28423 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:03.996400 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5f4fbe9c-b9c6-473b-a428-5abbff94bd95 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:04.004250 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5f4fbe9c-b9c6-473b-a428-5abbff94bd95 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.212564 Aug 19 09:20:04.004949 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 250/513] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:03 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:04.064268 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4c236cea-d7b9-4b33-8f3f-96001a836c43 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:04.065159 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4c236cea-d7b9-4b33-8f3f-96001a836c43 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:04.077237 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c236cea-d7b9-4b33-8f3f-96001a836c43 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:04.077769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c236cea-d7b9-4b33-8f3f-96001a836c43 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:04.078612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c236cea-d7b9-4b33-8f3f-96001a836c43 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:04.079116 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c236cea-d7b9-4b33-8f3f-96001a836c43 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:04.202744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4c236cea-d7b9-4b33-8f3f-96001a836c43 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:04.210351 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4c236cea-d7b9-4b33-8f3f-96001a836c43 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.150172 Aug 19 09:20:04.210918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 264/514] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:04 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:04.233899 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-417742d7-aacb-4af0-9579-570b5b70affc req-cf09917d-ef6e-4054-96c1-21a78f09036b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770a9eff-164f-464b-9ddc-85d731650432", "tag": "926dae50-59d9-47b4-9b81-d532dbdc9892"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:04.235486 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:20:04.235486 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:20:04.242775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-417742d7-aacb-4af0-9579-570b5b70affc req-cf09917d-ef6e-4054-96c1-21a78f09036b service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:04.243220 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-417742d7-aacb-4af0-9579-570b5b70affc req-cf09917d-ef6e-4054-96c1-21a78f09036b service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:04.260218 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-417742d7-aacb-4af0-9579-570b5b70affc req-cf09917d-ef6e-4054-96c1-21a78f09036b service nova] Creating event network-changed:926dae50-59d9-47b4-9b81-d532dbdc9892 for instance 770a9eff-164f-464b-9ddc-85d731650432 on hv-cinder-77387 Aug 19 09:20:04.264953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-417742d7-aacb-4af0-9579-570b5b70affc req-cf09917d-ef6e-4054-96c1-21a78f09036b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034534 Aug 19 09:20:04.265548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 251/515] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:20:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:20:04.808098 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3ce63f0b-ddb8-464e-99b6-324c8e4bfe2b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:04.808642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3ce63f0b-ddb8-464e-99b6-324c8e4bfe2b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:04.814968 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3ce63f0b-ddb8-464e-99b6-324c8e4bfe2b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:04.815453 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3ce63f0b-ddb8-464e-99b6-324c8e4bfe2b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:04.816215 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3ce63f0b-ddb8-464e-99b6-324c8e4bfe2b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:04.816646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3ce63f0b-ddb8-464e-99b6-324c8e4bfe2b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:04.849410 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7b2b7697-d463-4dc4-b2fa-c4cd07a8666b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:04.851359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7b2b7697-d463-4dc4-b2fa-c4cd07a8666b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:04.858026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b2b7697-d463-4dc4-b2fa-c4cd07a8666b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:04.858630 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b2b7697-d463-4dc4-b2fa-c4cd07a8666b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:04.859432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b2b7697-d463-4dc4-b2fa-c4cd07a8666b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:04.859870 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b2b7697-d463-4dc4-b2fa-c4cd07a8666b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:04.938385 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3ce63f0b-ddb8-464e-99b6-324c8e4bfe2b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:04.946026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3ce63f0b-ddb8-464e-99b6-324c8e4bfe2b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.141615 Aug 19 09:20:04.946575 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 265/516] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:04 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:05.021868 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-27301b87-475a-452d-86eb-319701636f88 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:05.022606 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-27301b87-475a-452d-86eb-319701636f88 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:05.028331 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27301b87-475a-452d-86eb-319701636f88 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:05.028784 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27301b87-475a-452d-86eb-319701636f88 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:05.029555 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27301b87-475a-452d-86eb-319701636f88 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:05.029992 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27301b87-475a-452d-86eb-319701636f88 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:05.151019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-27301b87-475a-452d-86eb-319701636f88 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:05.158644 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-27301b87-475a-452d-86eb-319701636f88 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.141238 Aug 19 09:20:05.159189 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 266/517] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:05 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:05.227508 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e7d35347-d21b-49be-98b2-33db772ad48e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:05.228110 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e7d35347-d21b-49be-98b2-33db772ad48e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:05.233787 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e7d35347-d21b-49be-98b2-33db772ad48e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:05.234227 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e7d35347-d21b-49be-98b2-33db772ad48e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:05.234987 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e7d35347-d21b-49be-98b2-33db772ad48e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:05.235448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e7d35347-d21b-49be-98b2-33db772ad48e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:05.353821 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e7d35347-d21b-49be-98b2-33db772ad48e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:05.361763 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e7d35347-d21b-49be-98b2-33db772ad48e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.137334 Aug 19 09:20:05.362539 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 267/518] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:05 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:05.962950 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3c73d0d9-5e32-4ef8-9959-b5cc1b972427 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:05.963582 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3c73d0d9-5e32-4ef8-9959-b5cc1b972427 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:05.969369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c73d0d9-5e32-4ef8-9959-b5cc1b972427 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:05.969813 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c73d0d9-5e32-4ef8-9959-b5cc1b972427 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:05.970642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c73d0d9-5e32-4ef8-9959-b5cc1b972427 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:05.971086 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c73d0d9-5e32-4ef8-9959-b5cc1b972427 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:06.089514 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3c73d0d9-5e32-4ef8-9959-b5cc1b972427 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:06.096770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3c73d0d9-5e32-4ef8-9959-b5cc1b972427 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.137408 Aug 19 09:20:06.097322 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 268/519] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:05 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:06.175511 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2964023e-af80-480f-b7cd-34abbbaef206 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:06.176043 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2964023e-af80-480f-b7cd-34abbbaef206 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:06.181591 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2964023e-af80-480f-b7cd-34abbbaef206 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:06.182032 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2964023e-af80-480f-b7cd-34abbbaef206 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:06.182790 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2964023e-af80-480f-b7cd-34abbbaef206 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:06.183218 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2964023e-af80-480f-b7cd-34abbbaef206 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:06.303396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2964023e-af80-480f-b7cd-34abbbaef206 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:06.310445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2964023e-af80-480f-b7cd-34abbbaef206 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.139149 Aug 19 09:20:06.310986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 269/520] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:06 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:06.378199 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8ab715d2-9589-476d-a28f-ef919f834786 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:06.378799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8ab715d2-9589-476d-a28f-ef919f834786 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:06.384558 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8ab715d2-9589-476d-a28f-ef919f834786 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:06.385001 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8ab715d2-9589-476d-a28f-ef919f834786 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:06.385752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8ab715d2-9589-476d-a28f-ef919f834786 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:06.386178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8ab715d2-9589-476d-a28f-ef919f834786 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:06.504356 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8ab715d2-9589-476d-a28f-ef919f834786 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:06.511396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8ab715d2-9589-476d-a28f-ef919f834786 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.136901 Aug 19 09:20:06.511933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 270/521] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:06 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:07.113646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fd7e82cc-ce0c-4820-a72c-dececabcdca2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:07.114257 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fd7e82cc-ce0c-4820-a72c-dececabcdca2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:07.120467 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd7e82cc-ce0c-4820-a72c-dececabcdca2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:07.120917 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd7e82cc-ce0c-4820-a72c-dececabcdca2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:07.121683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd7e82cc-ce0c-4820-a72c-dececabcdca2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:07.122116 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd7e82cc-ce0c-4820-a72c-dececabcdca2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:07.237456 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fd7e82cc-ce0c-4820-a72c-dececabcdca2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:07.244598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fd7e82cc-ce0c-4820-a72c-dececabcdca2 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.134964 Aug 19 09:20:07.245158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 271/522] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:07 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:07.326306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-20af4d15-3569-45f1-ac36-dd545fd50ae9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:07.326907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-20af4d15-3569-45f1-ac36-dd545fd50ae9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:07.332912 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-20af4d15-3569-45f1-ac36-dd545fd50ae9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:07.333358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-20af4d15-3569-45f1-ac36-dd545fd50ae9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:07.334119 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-20af4d15-3569-45f1-ac36-dd545fd50ae9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:07.334550 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-20af4d15-3569-45f1-ac36-dd545fd50ae9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:07.456210 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-20af4d15-3569-45f1-ac36-dd545fd50ae9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:07.464880 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-20af4d15-3569-45f1-ac36-dd545fd50ae9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.142078 Aug 19 09:20:07.465441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 272/523] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:07 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:07.527440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-72f17250-a246-49d5-8e4d-da188963982e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:07.528042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-72f17250-a246-49d5-8e4d-da188963982e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:07.533821 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-72f17250-a246-49d5-8e4d-da188963982e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:07.534262 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-72f17250-a246-49d5-8e4d-da188963982e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:07.535041 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-72f17250-a246-49d5-8e4d-da188963982e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:07.535496 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-72f17250-a246-49d5-8e4d-da188963982e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:07.655741 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-72f17250-a246-49d5-8e4d-da188963982e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:07.663558 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-72f17250-a246-49d5-8e4d-da188963982e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.139611 Aug 19 09:20:07.664117 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 273/524] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:07 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:08.261614 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7ac9fc58-8c7a-43a6-8d14-ffb72435b064 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:08.262226 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7ac9fc58-8c7a-43a6-8d14-ffb72435b064 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:08.268561 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ac9fc58-8c7a-43a6-8d14-ffb72435b064 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:08.269006 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ac9fc58-8c7a-43a6-8d14-ffb72435b064 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:08.269772 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ac9fc58-8c7a-43a6-8d14-ffb72435b064 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:08.270212 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ac9fc58-8c7a-43a6-8d14-ffb72435b064 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:08.387595 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7ac9fc58-8c7a-43a6-8d14-ffb72435b064 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:08.395472 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7ac9fc58-8c7a-43a6-8d14-ffb72435b064 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.137477 Aug 19 09:20:08.396040 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 274/525] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:08 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:08.448867 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7b2b7697-d463-4dc4-b2fa-c4cd07a8666b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 3.603919 Aug 19 09:20:08.449517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 252/526] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:04 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 3606 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:08.481766 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-768e8109-f15b-400d-81e1-2b07d4f86d73 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:08.482372 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-768e8109-f15b-400d-81e1-2b07d4f86d73 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:08.488914 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-768e8109-f15b-400d-81e1-2b07d4f86d73 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:08.489357 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-768e8109-f15b-400d-81e1-2b07d4f86d73 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:08.490131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-768e8109-f15b-400d-81e1-2b07d4f86d73 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:08.490563 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-768e8109-f15b-400d-81e1-2b07d4f86d73 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:08.613572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-768e8109-f15b-400d-81e1-2b07d4f86d73 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:08.620707 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-768e8109-f15b-400d-81e1-2b07d4f86d73 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.142620 Aug 19 09:20:08.621252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 275/527] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:08 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:08.680172 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6459cde1-6aa7-4f10-91dc-17ec3a6d3a4a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:08.680870 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6459cde1-6aa7-4f10-91dc-17ec3a6d3a4a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:08.687110 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6459cde1-6aa7-4f10-91dc-17ec3a6d3a4a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:08.687577 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6459cde1-6aa7-4f10-91dc-17ec3a6d3a4a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:08.688339 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6459cde1-6aa7-4f10-91dc-17ec3a6d3a4a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:08.688768 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6459cde1-6aa7-4f10-91dc-17ec3a6d3a4a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:08.848358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6459cde1-6aa7-4f10-91dc-17ec3a6d3a4a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:08.855867 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6459cde1-6aa7-4f10-91dc-17ec3a6d3a4a tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.179575 Aug 19 09:20:08.856672 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 253/528] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:08 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:09.411870 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f301c4fb-c95c-48e5-a33d-a42aa992087a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:09.412477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f301c4fb-c95c-48e5-a33d-a42aa992087a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:09.418637 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f301c4fb-c95c-48e5-a33d-a42aa992087a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:09.419081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f301c4fb-c95c-48e5-a33d-a42aa992087a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:09.419875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f301c4fb-c95c-48e5-a33d-a42aa992087a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:09.420314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f301c4fb-c95c-48e5-a33d-a42aa992087a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:09.460389 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cb3cac11-5910-4b1a-ba3f-34e917255a42 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:09.461307 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-cb3cac11-5910-4b1a-ba3f-34e917255a42 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:09.467000 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cb3cac11-5910-4b1a-ba3f-34e917255a42 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:09.467485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cb3cac11-5910-4b1a-ba3f-34e917255a42 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:09.468271 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cb3cac11-5910-4b1a-ba3f-34e917255a42 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:09.468702 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cb3cac11-5910-4b1a-ba3f-34e917255a42 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:09.540491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f301c4fb-c95c-48e5-a33d-a42aa992087a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:09.547510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f301c4fb-c95c-48e5-a33d-a42aa992087a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.139864 Aug 19 09:20:09.548056 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 276/529] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:09 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:09.636767 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-52d87a24-908e-4389-9852-6a37246253ba tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:09.637305 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-52d87a24-908e-4389-9852-6a37246253ba tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:09.642840 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-52d87a24-908e-4389-9852-6a37246253ba tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:09.643308 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-52d87a24-908e-4389-9852-6a37246253ba tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:09.644560 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-52d87a24-908e-4389-9852-6a37246253ba tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:09.644984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-52d87a24-908e-4389-9852-6a37246253ba tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:09.764494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-52d87a24-908e-4389-9852-6a37246253ba tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:09.771692 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-52d87a24-908e-4389-9852-6a37246253ba tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1511 microversion: 2.1 time: 0.138450 Aug 19 09:20:09.772510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 277/530] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:09 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1511 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:09.872600 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-183bcb5f-ef44-455b-b632-1d7e17fe826c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:09.873236 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-183bcb5f-ef44-455b-b632-1d7e17fe826c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:09.879653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-183bcb5f-ef44-455b-b632-1d7e17fe826c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:09.880100 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-183bcb5f-ef44-455b-b632-1d7e17fe826c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:09.880863 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-183bcb5f-ef44-455b-b632-1d7e17fe826c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:09.881296 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-183bcb5f-ef44-455b-b632-1d7e17fe826c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:09.919628 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-cb3cac11-5910-4b1a-ba3f-34e917255a42 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.462920 Aug 19 09:20:09.920411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 254/531] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:09 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:20:10.048233 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-183bcb5f-ef44-455b-b632-1d7e17fe826c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:10.057330 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-183bcb5f-ef44-455b-b632-1d7e17fe826c tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.188198 Aug 19 09:20:10.064020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 278/532] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:09 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:10.565396 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-588f12f1-5bac-4031-a14d-ce899998618a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:10.566192 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-588f12f1-5bac-4031-a14d-ce899998618a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:10.572699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-588f12f1-5bac-4031-a14d-ce899998618a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:10.573140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-588f12f1-5bac-4031-a14d-ce899998618a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:10.573915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-588f12f1-5bac-4031-a14d-ce899998618a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:10.574469 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-588f12f1-5bac-4031-a14d-ce899998618a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:10.694756 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-588f12f1-5bac-4031-a14d-ce899998618a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:10.701848 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-588f12f1-5bac-4031-a14d-ce899998618a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.140661 Aug 19 09:20:10.702400 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 255/533] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:10 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:10.788354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-79c57534-3724-4d45-85e5-c1f369d33fb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:10.788954 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-79c57534-3724-4d45-85e5-c1f369d33fb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:10.795865 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79c57534-3724-4d45-85e5-c1f369d33fb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:10.796313 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79c57534-3724-4d45-85e5-c1f369d33fb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:10.797069 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79c57534-3724-4d45-85e5-c1f369d33fb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:10.797498 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79c57534-3724-4d45-85e5-c1f369d33fb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:10.915596 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-79c57534-3724-4d45-85e5-c1f369d33fb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:10.922618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-79c57534-3724-4d45-85e5-c1f369d33fb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1517 microversion: 2.1 time: 0.137851 Aug 19 09:20:10.923173 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 279/534] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:10 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1517 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:10.931909 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ff173001-51db-4927-adb9-8a74d3631b23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:10.932847 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ff173001-51db-4927-adb9-8a74d3631b23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:10.938984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff173001-51db-4927-adb9-8a74d3631b23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:10.939131 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff173001-51db-4927-adb9-8a74d3631b23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:10.939883 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff173001-51db-4927-adb9-8a74d3631b23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:10.940803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff173001-51db-4927-adb9-8a74d3631b23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:11.074279 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-89cc1524-06f5-41e7-ac95-0a6d81fa48b6 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:11.074935 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-89cc1524-06f5-41e7-ac95-0a6d81fa48b6 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:11.080677 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89cc1524-06f5-41e7-ac95-0a6d81fa48b6 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:11.081169 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89cc1524-06f5-41e7-ac95-0a6d81fa48b6 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:11.081993 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89cc1524-06f5-41e7-ac95-0a6d81fa48b6 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:11.082427 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89cc1524-06f5-41e7-ac95-0a6d81fa48b6 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:11.235587 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-89cc1524-06f5-41e7-ac95-0a6d81fa48b6 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:11.244058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-89cc1524-06f5-41e7-ac95-0a6d81fa48b6 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.173346 Aug 19 09:20:11.244651 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 280/535] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:11 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:11.718909 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-02a5c6bc-f0cc-419b-9732-be9f85be0ed4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:11.719462 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-02a5c6bc-f0cc-419b-9732-be9f85be0ed4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:11.725494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-02a5c6bc-f0cc-419b-9732-be9f85be0ed4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:11.725932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-02a5c6bc-f0cc-419b-9732-be9f85be0ed4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:11.726681 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-02a5c6bc-f0cc-419b-9732-be9f85be0ed4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:11.727109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-02a5c6bc-f0cc-419b-9732-be9f85be0ed4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:11.846152 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-02a5c6bc-f0cc-419b-9732-be9f85be0ed4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:11.854067 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-02a5c6bc-f0cc-419b-9732-be9f85be0ed4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.138828 Aug 19 09:20:11.854629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 281/536] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:11 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:12.261500 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d62f9981-95fa-4f92-a5c6-bcbef291d860 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:12.262109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d62f9981-95fa-4f92-a5c6-bcbef291d860 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:12.267842 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d62f9981-95fa-4f92-a5c6-bcbef291d860 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:12.268310 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d62f9981-95fa-4f92-a5c6-bcbef291d860 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:12.269052 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d62f9981-95fa-4f92-a5c6-bcbef291d860 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:12.269483 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d62f9981-95fa-4f92-a5c6-bcbef291d860 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:12.388419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d62f9981-95fa-4f92-a5c6-bcbef291d860 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:12.395479 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d62f9981-95fa-4f92-a5c6-bcbef291d860 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.137496 Aug 19 09:20:12.396029 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 282/537] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:12 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:12.871458 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-91104d43-af7b-4224-89aa-026be4a126d6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:12.872104 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-91104d43-af7b-4224-89aa-026be4a126d6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:12.878526 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-91104d43-af7b-4224-89aa-026be4a126d6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:12.879058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-91104d43-af7b-4224-89aa-026be4a126d6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:12.879851 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-91104d43-af7b-4224-89aa-026be4a126d6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:12.880285 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-91104d43-af7b-4224-89aa-026be4a126d6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:12.997292 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-91104d43-af7b-4224-89aa-026be4a126d6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:13.004484 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-91104d43-af7b-4224-89aa-026be4a126d6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.136675 Aug 19 09:20:13.005053 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 283/538] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:12 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:13.412349 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0e6e9327-b900-4c04-8fc6-18b897871f3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:13.412991 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0e6e9327-b900-4c04-8fc6-18b897871f3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:13.418748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0e6e9327-b900-4c04-8fc6-18b897871f3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:13.419191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0e6e9327-b900-4c04-8fc6-18b897871f3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:13.419998 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0e6e9327-b900-4c04-8fc6-18b897871f3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:13.420431 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0e6e9327-b900-4c04-8fc6-18b897871f3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:13.542512 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0e6e9327-b900-4c04-8fc6-18b897871f3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:13.549616 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0e6e9327-b900-4c04-8fc6-18b897871f3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.141540 Aug 19 09:20:13.550466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 284/539] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:13 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:14.021648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-03adaba0-b75d-431c-9505-8292cfc94a12 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:14.022418 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-03adaba0-b75d-431c-9505-8292cfc94a12 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:14.028590 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03adaba0-b75d-431c-9505-8292cfc94a12 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:14.029037 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03adaba0-b75d-431c-9505-8292cfc94a12 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:14.029799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03adaba0-b75d-431c-9505-8292cfc94a12 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:14.030231 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03adaba0-b75d-431c-9505-8292cfc94a12 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:14.149464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-03adaba0-b75d-431c-9505-8292cfc94a12 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:14.156556 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-03adaba0-b75d-431c-9505-8292cfc94a12 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.139261 Aug 19 09:20:14.157108 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 285/540] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:14 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:14.567811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9198473c-836f-4254-91a3-ff15a29da082 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:14.568380 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9198473c-836f-4254-91a3-ff15a29da082 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:14.574076 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9198473c-836f-4254-91a3-ff15a29da082 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:14.574516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9198473c-836f-4254-91a3-ff15a29da082 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:14.575293 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9198473c-836f-4254-91a3-ff15a29da082 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:14.575723 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9198473c-836f-4254-91a3-ff15a29da082 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:14.691380 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9198473c-836f-4254-91a3-ff15a29da082 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:14.698410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9198473c-836f-4254-91a3-ff15a29da082 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.134825 Aug 19 09:20:14.698959 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 286/541] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:14 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:15.172693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5d931f05-505b-4f19-bcd4-9284e17dadf3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:15.173308 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5d931f05-505b-4f19-bcd4-9284e17dadf3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:15.179162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5d931f05-505b-4f19-bcd4-9284e17dadf3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:15.179636 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5d931f05-505b-4f19-bcd4-9284e17dadf3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:15.180404 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5d931f05-505b-4f19-bcd4-9284e17dadf3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:15.180833 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5d931f05-505b-4f19-bcd4-9284e17dadf3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:15.306252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5d931f05-505b-4f19-bcd4-9284e17dadf3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:15.313458 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5d931f05-505b-4f19-bcd4-9284e17dadf3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.144387 Aug 19 09:20:15.314013 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 287/542] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:15 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:15.708907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ff173001-51db-4927-adb9-8a74d3631b23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 4.780723 Aug 19 09:20:15.709942 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 256/543] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:10 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 4783 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:20:15.714649 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8948b206-0f8c-4583-8b03-7d02b3787a2d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:15.715311 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8948b206-0f8c-4583-8b03-7d02b3787a2d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:15.720996 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8948b206-0f8c-4583-8b03-7d02b3787a2d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:15.721439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8948b206-0f8c-4583-8b03-7d02b3787a2d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:15.722187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8948b206-0f8c-4583-8b03-7d02b3787a2d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:15.722655 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8948b206-0f8c-4583-8b03-7d02b3787a2d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:15.838456 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8948b206-0f8c-4583-8b03-7d02b3787a2d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:15.845463 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8948b206-0f8c-4583-8b03-7d02b3787a2d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.134361 Aug 19 09:20:15.846012 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 288/544] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:15 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:16.331177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-926b4df1-f71f-42e8-b45d-34b29b31e71f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:16.332434 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-926b4df1-f71f-42e8-b45d-34b29b31e71f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:16.338873 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-926b4df1-f71f-42e8-b45d-34b29b31e71f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:16.339350 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-926b4df1-f71f-42e8-b45d-34b29b31e71f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:16.340115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-926b4df1-f71f-42e8-b45d-34b29b31e71f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:16.340600 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-926b4df1-f71f-42e8-b45d-34b29b31e71f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:16.486878 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-926b4df1-f71f-42e8-b45d-34b29b31e71f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:16.495230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-926b4df1-f71f-42e8-b45d-34b29b31e71f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.168087 Aug 19 09:20:16.495825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 257/545] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:16 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:16.719803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ca73fc9f-ee77-438d-b39a-8889d3ecdbc4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:16.720773 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ca73fc9f-ee77-438d-b39a-8889d3ecdbc4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:16.727301 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca73fc9f-ee77-438d-b39a-8889d3ecdbc4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:16.727764 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca73fc9f-ee77-438d-b39a-8889d3ecdbc4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:16.728532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca73fc9f-ee77-438d-b39a-8889d3ecdbc4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:16.728967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ca73fc9f-ee77-438d-b39a-8889d3ecdbc4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:16.862572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ca73fc9f-ee77-438d-b39a-8889d3ecdbc4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.146078 Aug 19 09:20:16.863522 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 289/546] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:16 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:20:16.863637 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c67491c0-852e-450f-99c2-046738341efc tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:16.864318 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c67491c0-852e-450f-99c2-046738341efc tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:16.870381 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c67491c0-852e-450f-99c2-046738341efc tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:16.870822 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c67491c0-852e-450f-99c2-046738341efc tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:16.871617 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c67491c0-852e-450f-99c2-046738341efc tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:16.872047 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c67491c0-852e-450f-99c2-046738341efc tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:16.998436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c67491c0-852e-450f-99c2-046738341efc tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:17.002679 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c67491c0-852e-450f-99c2-046738341efc tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.143467 Aug 19 09:20:17.003245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 258/547] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:16 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:17.514010 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3c1617d4-8169-489b-8f08-77de68e7323d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:17.514699 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3c1617d4-8169-489b-8f08-77de68e7323d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:17.521411 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c1617d4-8169-489b-8f08-77de68e7323d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:17.521797 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c1617d4-8169-489b-8f08-77de68e7323d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:17.522551 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c1617d4-8169-489b-8f08-77de68e7323d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:17.522974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c1617d4-8169-489b-8f08-77de68e7323d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:17.649035 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3c1617d4-8169-489b-8f08-77de68e7323d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:17.656534 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3c1617d4-8169-489b-8f08-77de68e7323d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.146406 Aug 19 09:20:17.657090 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 290/548] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:17 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:17.831288 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-b75364e7-0280-4d59-ae1c-00493522653f req-4197beaa-16ff-48dd-80db-fc17bdd67209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c850e5cb-c98e-487b-941e-5e12784e18aa", "name": "network-vif-plugged", "status": "completed", "tag": "b2bc4996-8e90-4c79-9ed8-262730602376"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:17.833041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:20:17.833041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:20:17.840032 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-b75364e7-0280-4d59-ae1c-00493522653f req-4197beaa-16ff-48dd-80db-fc17bdd67209 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:17.840482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-b75364e7-0280-4d59-ae1c-00493522653f req-4197beaa-16ff-48dd-80db-fc17bdd67209 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:17.851835 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-b75364e7-0280-4d59-ae1c-00493522653f req-4197beaa-16ff-48dd-80db-fc17bdd67209 service nova] Creating event network-vif-plugged:b2bc4996-8e90-4c79-9ed8-262730602376 for instance c850e5cb-c98e-487b-941e-5e12784e18aa on hv-cinder-77387 Aug 19 09:20:17.856499 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-b75364e7-0280-4d59-ae1c-00493522653f req-4197beaa-16ff-48dd-80db-fc17bdd67209 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028819 Aug 19 09:20:17.857074 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 259/549] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:20:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:20:17.874371 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0648c091-194e-49a9-9aba-041a1dc2f806 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:17.875529 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0648c091-194e-49a9-9aba-041a1dc2f806 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:17.882440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0648c091-194e-49a9-9aba-041a1dc2f806 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:17.882954 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0648c091-194e-49a9-9aba-041a1dc2f806 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:17.884190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0648c091-194e-49a9-9aba-041a1dc2f806 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:17.884567 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0648c091-194e-49a9-9aba-041a1dc2f806 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:18.011700 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0648c091-194e-49a9-9aba-041a1dc2f806 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.140691 Aug 19 09:20:18.015921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 291/550] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:17 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:18.021863 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-65322793-e610-46bc-8a34-ba34c0374633 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:18.022575 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-65322793-e610-46bc-8a34-ba34c0374633 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:18.028871 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65322793-e610-46bc-8a34-ba34c0374633 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:18.029317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65322793-e610-46bc-8a34-ba34c0374633 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:18.030094 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65322793-e610-46bc-8a34-ba34c0374633 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:18.030537 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65322793-e610-46bc-8a34-ba34c0374633 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:18.208748 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-65322793-e610-46bc-8a34-ba34c0374633 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:18.217173 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-65322793-e610-46bc-8a34-ba34c0374633 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.199788 Aug 19 09:20:18.217749 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 260/551] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:18 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:18.566246 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-941a4622-8b3d-4020-8802-0305a0b0bf38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:18.566981 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-941a4622-8b3d-4020-8802-0305a0b0bf38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:18.573428 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-941a4622-8b3d-4020-8802-0305a0b0bf38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:18.573872 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-941a4622-8b3d-4020-8802-0305a0b0bf38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:18.574625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-941a4622-8b3d-4020-8802-0305a0b0bf38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:18.575056 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-941a4622-8b3d-4020-8802-0305a0b0bf38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:18.674491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-05ca3594-a440-4ba9-8c05-eb7961bf7c08 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:18.675208 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-05ca3594-a440-4ba9-8c05-eb7961bf7c08 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:18.683392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05ca3594-a440-4ba9-8c05-eb7961bf7c08 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:18.683898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05ca3594-a440-4ba9-8c05-eb7961bf7c08 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:18.684911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05ca3594-a440-4ba9-8c05-eb7961bf7c08 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:18.686673 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05ca3594-a440-4ba9-8c05-eb7961bf7c08 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:18.720903 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-941a4622-8b3d-4020-8802-0305a0b0bf38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:18.729339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-941a4622-8b3d-4020-8802-0305a0b0bf38 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1517 microversion: 2.1 time: 0.167153 Aug 19 09:20:18.730266 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 292/552] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:18 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:18.749640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4c4ba562-5798-473e-b674-a0b2733cf554 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b28d81c0-49ea-40ca-b1b8-049f29372e17"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:18.750830 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4c4ba562-5798-473e-b674-a0b2733cf554 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:18.762468 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c4ba562-5798-473e-b674-a0b2733cf554 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:18.763134 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c4ba562-5798-473e-b674-a0b2733cf554 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:18.764111 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c4ba562-5798-473e-b674-a0b2733cf554 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:18.764766 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c4ba562-5798-473e-b674-a0b2733cf554 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:18.856613 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-05ca3594-a440-4ba9-8c05-eb7961bf7c08 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:18.864789 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-05ca3594-a440-4ba9-8c05-eb7961bf7c08 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.194442 Aug 19 09:20:18.865532 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 261/553] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:18 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:19.024136 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1f5f011d-7571-4e29-9ea3-2453e33ba466 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:19.025095 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1f5f011d-7571-4e29-9ea3-2453e33ba466 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:19.031984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1f5f011d-7571-4e29-9ea3-2453e33ba466 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:19.032426 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1f5f011d-7571-4e29-9ea3-2453e33ba466 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:19.033186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1f5f011d-7571-4e29-9ea3-2453e33ba466 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:19.033610 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1f5f011d-7571-4e29-9ea3-2453e33ba466 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:19.098175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4c4ba562-5798-473e-b674-a0b2733cf554 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355130 Aug 19 09:20:19.099054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 293/554] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:20:18 2021] POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:20:19.228406 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1f5f011d-7571-4e29-9ea3-2453e33ba466 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.208714 Aug 19 09:20:19.229062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 262/555] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:19 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:20:19.239446 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1de37246-f95b-474c-8ddc-a9656c9cad49 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:19.240141 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1de37246-f95b-474c-8ddc-a9656c9cad49 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:19.246132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1de37246-f95b-474c-8ddc-a9656c9cad49 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:19.246586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1de37246-f95b-474c-8ddc-a9656c9cad49 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:19.247352 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1de37246-f95b-474c-8ddc-a9656c9cad49 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:19.247781 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1de37246-f95b-474c-8ddc-a9656c9cad49 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:19.375427 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1de37246-f95b-474c-8ddc-a9656c9cad49 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:19.384174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1de37246-f95b-474c-8ddc-a9656c9cad49 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1314 microversion: 2.1 time: 0.149381 Aug 19 09:20:19.384738 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 294/556] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:19 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:19.883157 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5efbf4f4-248b-42bf-aacb-e2a599adb4df tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:19.883842 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5efbf4f4-248b-42bf-aacb-e2a599adb4df tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:19.890352 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5efbf4f4-248b-42bf-aacb-e2a599adb4df tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:19.890808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5efbf4f4-248b-42bf-aacb-e2a599adb4df tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:19.891597 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5efbf4f4-248b-42bf-aacb-e2a599adb4df tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:19.892033 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5efbf4f4-248b-42bf-aacb-e2a599adb4df tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:20.025057 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5efbf4f4-248b-42bf-aacb-e2a599adb4df tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:20.034001 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5efbf4f4-248b-42bf-aacb-e2a599adb4df tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.155849 Aug 19 09:20:20.035639 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 263/557] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:19 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:20.241920 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f54d0019-d47c-4fbd-a523-a9723c582d09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:20.242980 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f54d0019-d47c-4fbd-a523-a9723c582d09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:20.257373 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f54d0019-d47c-4fbd-a523-a9723c582d09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:20.257893 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f54d0019-d47c-4fbd-a523-a9723c582d09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:20.259198 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f54d0019-d47c-4fbd-a523-a9723c582d09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:20.259981 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f54d0019-d47c-4fbd-a523-a9723c582d09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:20.399694 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f54d0019-d47c-4fbd-a523-a9723c582d09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.163195 Aug 19 09:20:20.400891 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-405ca44f-e77e-4df7-a71c-7b10c8d8cee8 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:20.401098 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 295/558] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:20 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:20.402123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-405ca44f-e77e-4df7-a71c-7b10c8d8cee8 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:20.408978 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-405ca44f-e77e-4df7-a71c-7b10c8d8cee8 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:20.409556 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-405ca44f-e77e-4df7-a71c-7b10c8d8cee8 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:20.412585 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-405ca44f-e77e-4df7-a71c-7b10c8d8cee8 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:20.413448 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-405ca44f-e77e-4df7-a71c-7b10c8d8cee8 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:20.573447 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-405ca44f-e77e-4df7-a71c-7b10c8d8cee8 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:20.585183 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-405ca44f-e77e-4df7-a71c-7b10c8d8cee8 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1499 microversion: 2.1 time: 0.187378 Aug 19 09:20:20.585766 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 264/559] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:20 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1499 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:21.055940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2d23ae88-96c1-480b-9ac5-ca816485b58f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:21.056748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2d23ae88-96c1-480b-9ac5-ca816485b58f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:21.065089 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d23ae88-96c1-480b-9ac5-ca816485b58f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:21.069448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d23ae88-96c1-480b-9ac5-ca816485b58f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:21.071318 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d23ae88-96c1-480b-9ac5-ca816485b58f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:21.073602 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d23ae88-96c1-480b-9ac5-ca816485b58f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:21.201714 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2d23ae88-96c1-480b-9ac5-ca816485b58f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:21.209186 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2d23ae88-96c1-480b-9ac5-ca816485b58f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.160689 Aug 19 09:20:21.209868 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 296/560] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:21 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:21.411789 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0d747a05-2481-4fd6-a7d9-4787d23efc1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:21.412696 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0d747a05-2481-4fd6-a7d9-4787d23efc1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:21.418816 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0d747a05-2481-4fd6-a7d9-4787d23efc1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:21.419256 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0d747a05-2481-4fd6-a7d9-4787d23efc1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:21.420044 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0d747a05-2481-4fd6-a7d9-4787d23efc1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:21.420475 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0d747a05-2481-4fd6-a7d9-4787d23efc1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:21.679299 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0d747a05-2481-4fd6-a7d9-4787d23efc1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.271220 Aug 19 09:20:21.679866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 265/561] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:21 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:22.226669 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3fc25239-03c5-4335-b8a5-9da2a2faaab6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:22.227299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3fc25239-03c5-4335-b8a5-9da2a2faaab6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:22.233528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3fc25239-03c5-4335-b8a5-9da2a2faaab6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:22.233973 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3fc25239-03c5-4335-b8a5-9da2a2faaab6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:22.234722 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3fc25239-03c5-4335-b8a5-9da2a2faaab6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:22.235151 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3fc25239-03c5-4335-b8a5-9da2a2faaab6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:22.354909 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3fc25239-03c5-4335-b8a5-9da2a2faaab6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:22.362076 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3fc25239-03c5-4335-b8a5-9da2a2faaab6 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.139992 Aug 19 09:20:22.362653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 297/562] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:22 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:22.691069 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5318bd8a-b01a-4887-9f25-a09115642105 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:22.692095 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5318bd8a-b01a-4887-9f25-a09115642105 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:22.698426 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5318bd8a-b01a-4887-9f25-a09115642105 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:22.698867 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5318bd8a-b01a-4887-9f25-a09115642105 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:22.699640 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5318bd8a-b01a-4887-9f25-a09115642105 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:22.700068 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5318bd8a-b01a-4887-9f25-a09115642105 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:23.379473 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c8e135dd-f82e-4204-ba86-e90c4dc8c005 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:23.380150 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c8e135dd-f82e-4204-ba86-e90c4dc8c005 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:23.386886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c8e135dd-f82e-4204-ba86-e90c4dc8c005 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:23.387364 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c8e135dd-f82e-4204-ba86-e90c4dc8c005 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:23.388128 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c8e135dd-f82e-4204-ba86-e90c4dc8c005 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:23.388558 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c8e135dd-f82e-4204-ba86-e90c4dc8c005 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:23.510795 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c8e135dd-f82e-4204-ba86-e90c4dc8c005 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:23.517821 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c8e135dd-f82e-4204-ba86-e90c4dc8c005 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.142489 Aug 19 09:20:23.518373 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 298/563] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:23 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:24.535928 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-267cd103-b8fd-4045-a879-b2deb9b4213e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:24.536537 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-267cd103-b8fd-4045-a879-b2deb9b4213e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:24.542417 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-267cd103-b8fd-4045-a879-b2deb9b4213e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:24.542858 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-267cd103-b8fd-4045-a879-b2deb9b4213e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:24.543643 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-267cd103-b8fd-4045-a879-b2deb9b4213e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:24.544069 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-267cd103-b8fd-4045-a879-b2deb9b4213e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:24.671478 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-267cd103-b8fd-4045-a879-b2deb9b4213e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:24.678916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-267cd103-b8fd-4045-a879-b2deb9b4213e tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.147448 Aug 19 09:20:24.679509 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 299/564] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:24 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:25.607113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5318bd8a-b01a-4887-9f25-a09115642105 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 2.919839 Aug 19 09:20:25.607724 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 266/565] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:22 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 2922 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:25.694841 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f9496f78-4ab5-4a8c-9081-088616693ccc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:25.695489 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f9496f78-4ab5-4a8c-9081-088616693ccc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:25.701342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9496f78-4ab5-4a8c-9081-088616693ccc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:25.701790 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9496f78-4ab5-4a8c-9081-088616693ccc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:25.702592 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9496f78-4ab5-4a8c-9081-088616693ccc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:25.702981 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9496f78-4ab5-4a8c-9081-088616693ccc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:25.836885 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f9496f78-4ab5-4a8c-9081-088616693ccc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:25.844200 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f9496f78-4ab5-4a8c-9081-088616693ccc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.153471 Aug 19 09:20:25.845006 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 300/566] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:25 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:25.880747 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a171c02b-67da-477f-a9ee-2e18745e5a2e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:25.881426 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a171c02b-67da-477f-a9ee-2e18745e5a2e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:25.888410 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a171c02b-67da-477f-a9ee-2e18745e5a2e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:25.888845 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a171c02b-67da-477f-a9ee-2e18745e5a2e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:25.889595 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a171c02b-67da-477f-a9ee-2e18745e5a2e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:25.890030 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a171c02b-67da-477f-a9ee-2e18745e5a2e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:25.913899 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a171c02b-67da-477f-a9ee-2e18745e5a2e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:20:25.985409 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a171c02b-67da-477f-a9ee-2e18745e5a2e tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 204 len: 0 microversion: 2.1 time: 0.108732 Aug 19 09:20:25.985989 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 267/567] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:20:25 2021] DELETE /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:20:25.994838 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1cdc72d2-0b61-4e50-a57d-1c183619c3c1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:25.995469 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1cdc72d2-0b61-4e50-a57d-1c183619c3c1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:26.001211 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cdc72d2-0b61-4e50-a57d-1c183619c3c1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:26.001649 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cdc72d2-0b61-4e50-a57d-1c183619c3c1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:26.002399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cdc72d2-0b61-4e50-a57d-1c183619c3c1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:26.002823 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cdc72d2-0b61-4e50-a57d-1c183619c3c1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:26.124819 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1cdc72d2-0b61-4e50-a57d-1c183619c3c1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:26.132404 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1cdc72d2-0b61-4e50-a57d-1c183619c3c1 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1505 microversion: 2.1 time: 0.141146 Aug 19 09:20:26.132962 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 301/568] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:25 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1505 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:26.618461 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3c8c8312-8500-46c9-ac41-0c8d232934f4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:26.619481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3c8c8312-8500-46c9-ac41-0c8d232934f4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:26.625264 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c8c8312-8500-46c9-ac41-0c8d232934f4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:26.625708 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c8c8312-8500-46c9-ac41-0c8d232934f4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:26.626525 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c8c8312-8500-46c9-ac41-0c8d232934f4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:26.626952 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c8c8312-8500-46c9-ac41-0c8d232934f4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:26.742510 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3c8c8312-8500-46c9-ac41-0c8d232934f4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.127981 Aug 19 09:20:26.743463 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 268/569] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:26 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:26.861419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5f2b9b44-2ff1-4be8-a1d0-bd1ee4fb841c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:26.862486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5f2b9b44-2ff1-4be8-a1d0-bd1ee4fb841c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:26.869965 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f2b9b44-2ff1-4be8-a1d0-bd1ee4fb841c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:26.870360 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f2b9b44-2ff1-4be8-a1d0-bd1ee4fb841c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:26.871048 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f2b9b44-2ff1-4be8-a1d0-bd1ee4fb841c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:26.871513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f2b9b44-2ff1-4be8-a1d0-bd1ee4fb841c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:26.994286 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5f2b9b44-2ff1-4be8-a1d0-bd1ee4fb841c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:27.001450 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5f2b9b44-2ff1-4be8-a1d0-bd1ee4fb841c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.144261 Aug 19 09:20:27.001998 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 302/570] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:26 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:27.149903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4283da1f-bbf2-44ea-9ac2-312ce3669131 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:27.150601 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4283da1f-bbf2-44ea-9ac2-312ce3669131 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:27.157195 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4283da1f-bbf2-44ea-9ac2-312ce3669131 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:27.157645 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4283da1f-bbf2-44ea-9ac2-312ce3669131 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:27.158408 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4283da1f-bbf2-44ea-9ac2-312ce3669131 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:27.158841 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4283da1f-bbf2-44ea-9ac2-312ce3669131 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:27.317404 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4283da1f-bbf2-44ea-9ac2-312ce3669131 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:27.325133 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4283da1f-bbf2-44ea-9ac2-312ce3669131 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1505 microversion: 2.1 time: 0.179180 Aug 19 09:20:27.325701 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 269/571] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:27 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:27.753818 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6cc1b26e-505f-4699-b9d7-6326ad22230c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:27.757563 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6cc1b26e-505f-4699-b9d7-6326ad22230c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:27.763568 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cc1b26e-505f-4699-b9d7-6326ad22230c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:27.764017 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cc1b26e-505f-4699-b9d7-6326ad22230c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:27.764781 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cc1b26e-505f-4699-b9d7-6326ad22230c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:27.765205 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cc1b26e-505f-4699-b9d7-6326ad22230c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:27.904535 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-a4d0b0b8-2ce6-4fa2-830c-4bd36bac6833 req-57b6e927-7bbf-4a8d-b490-e0f41745c052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770a9eff-164f-464b-9ddc-85d731650432", "name": "network-vif-plugged", "status": "completed", "tag": "926dae50-59d9-47b4-9b81-d532dbdc9892"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:27.906045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:20:27.906045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:20:27.913460 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-a4d0b0b8-2ce6-4fa2-830c-4bd36bac6833 req-57b6e927-7bbf-4a8d-b490-e0f41745c052 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:27.913982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-a4d0b0b8-2ce6-4fa2-830c-4bd36bac6833 req-57b6e927-7bbf-4a8d-b490-e0f41745c052 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:27.927594 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-a4d0b0b8-2ce6-4fa2-830c-4bd36bac6833 req-57b6e927-7bbf-4a8d-b490-e0f41745c052 service nova] Creating event network-vif-plugged:926dae50-59d9-47b4-9b81-d532dbdc9892 for instance 770a9eff-164f-464b-9ddc-85d731650432 on hv-cinder-77387 Aug 19 09:20:27.933347 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-a4d0b0b8-2ce6-4fa2-830c-4bd36bac6833 req-57b6e927-7bbf-4a8d-b490-e0f41745c052 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032622 Aug 19 09:20:27.934235 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 270/572] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:20:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:20:27.935969 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6cc1b26e-505f-4699-b9d7-6326ad22230c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.185158 Aug 19 09:20:27.936719 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 303/573] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:27 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:27.942516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7626d56d-1e7a-4848-882b-c930c76a5f86 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:27.944363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7626d56d-1e7a-4848-882b-c930c76a5f86 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:27.950905 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7626d56d-1e7a-4848-882b-c930c76a5f86 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:27.951614 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7626d56d-1e7a-4848-882b-c930c76a5f86 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:27.952570 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7626d56d-1e7a-4848-882b-c930c76a5f86 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:27.953210 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7626d56d-1e7a-4848-882b-c930c76a5f86 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:27.980571 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-7626d56d-1e7a-4848-882b-c930c76a5f86 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lazy-loading 'flavor' on Instance uuid f4c3bc8f-45ae-4a40-8a3d-d9642d8728df {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:20:28.018984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0aa2cf36-86dd-4c28-b7b7-bfcd663de36c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:28.026073 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0aa2cf36-86dd-4c28-b7b7-bfcd663de36c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:28.048647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0aa2cf36-86dd-4c28-b7b7-bfcd663de36c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:28.049092 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0aa2cf36-86dd-4c28-b7b7-bfcd663de36c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:28.049869 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0aa2cf36-86dd-4c28-b7b7-bfcd663de36c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:28.050299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0aa2cf36-86dd-4c28-b7b7-bfcd663de36c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:28.128477 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7626d56d-1e7a-4848-882b-c930c76a5f86 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/action" status: 200 len: 32 microversion: 2.1 time: 0.192875 Aug 19 09:20:28.131543 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 271/574] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:20:27 2021] POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:20:28.142676 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d0eb9c9c-64fb-4e55-b1c6-5db23edce735 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:28.143721 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d0eb9c9c-64fb-4e55-b1c6-5db23edce735 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:28.152871 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0eb9c9c-64fb-4e55-b1c6-5db23edce735 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:28.153851 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0eb9c9c-64fb-4e55-b1c6-5db23edce735 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:28.155101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0eb9c9c-64fb-4e55-b1c6-5db23edce735 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:28.155900 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0eb9c9c-64fb-4e55-b1c6-5db23edce735 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:28.208371 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0aa2cf36-86dd-4c28-b7b7-bfcd663de36c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:28.217061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0aa2cf36-86dd-4c28-b7b7-bfcd663de36c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.201972 Aug 19 09:20:28.217953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 304/575] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:28 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:28.344419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-79c50030-9340-4e67-bb47-92c49534c278 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:28.345216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-79c50030-9340-4e67-bb47-92c49534c278 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:28.352681 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79c50030-9340-4e67-bb47-92c49534c278 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:28.355860 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79c50030-9340-4e67-bb47-92c49534c278 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:28.356786 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79c50030-9340-4e67-bb47-92c49534c278 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:28.357323 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-79c50030-9340-4e67-bb47-92c49534c278 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:28.383020 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d0eb9c9c-64fb-4e55-b1c6-5db23edce735 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:28.392170 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d0eb9c9c-64fb-4e55-b1c6-5db23edce735 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.255737 Aug 19 09:20:28.403070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 272/576] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:28 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:28.541590 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-79c50030-9340-4e67-bb47-92c49534c278 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:28.549598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-79c50030-9340-4e67-bb47-92c49534c278 tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1505 microversion: 2.1 time: 0.210935 Aug 19 09:20:28.550368 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 305/577] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:28 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:28.948026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-20c2ca36-b27d-4ad2-8e3b-24d710592a95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:28.949067 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-20c2ca36-b27d-4ad2-8e3b-24d710592a95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:28.954736 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20c2ca36-b27d-4ad2-8e3b-24d710592a95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:28.955189 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20c2ca36-b27d-4ad2-8e3b-24d710592a95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:28.955994 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20c2ca36-b27d-4ad2-8e3b-24d710592a95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:28.956435 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20c2ca36-b27d-4ad2-8e3b-24d710592a95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:29.033153 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-0d8d2898-ca94-477d-a94d-fc859ea16616 req-03fec2f5-6fbf-40dd-bd6a-ad682fd524ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c850e5cb-c98e-487b-941e-5e12784e18aa", "name": "network-vif-deleted", "tag": "b2bc4996-8e90-4c79-9ed8-262730602376"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:29.034650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:20:29.034650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:20:29.042304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-0d8d2898-ca94-477d-a94d-fc859ea16616 req-03fec2f5-6fbf-40dd-bd6a-ad682fd524ba service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:29.042741 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-0d8d2898-ca94-477d-a94d-fc859ea16616 req-03fec2f5-6fbf-40dd-bd6a-ad682fd524ba service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:29.053290 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-0d8d2898-ca94-477d-a94d-fc859ea16616 req-03fec2f5-6fbf-40dd-bd6a-ad682fd524ba service nova] Creating event network-vif-deleted:b2bc4996-8e90-4c79-9ed8-262730602376 for instance c850e5cb-c98e-487b-941e-5e12784e18aa on hv-cinder-77387 Aug 19 09:20:29.057811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-0d8d2898-ca94-477d-a94d-fc859ea16616 req-03fec2f5-6fbf-40dd-bd6a-ad682fd524ba service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028269 Aug 19 09:20:29.058363 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 306/578] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:20:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:20:29.234668 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a57cee6d-f7bb-4184-ba05-3bee1894d484 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:29.235383 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a57cee6d-f7bb-4184-ba05-3bee1894d484 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:29.241967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a57cee6d-f7bb-4184-ba05-3bee1894d484 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:29.242497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a57cee6d-f7bb-4184-ba05-3bee1894d484 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:29.243459 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a57cee6d-f7bb-4184-ba05-3bee1894d484 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:29.243832 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a57cee6d-f7bb-4184-ba05-3bee1894d484 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:29.299879 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-20c2ca36-b27d-4ad2-8e3b-24d710592a95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.355363 Aug 19 09:20:29.303320 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 273/579] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:28 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:29.386840 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a57cee6d-f7bb-4184-ba05-3bee1894d484 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:29.393953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a57cee6d-f7bb-4184-ba05-3bee1894d484 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.163728 Aug 19 09:20:29.394596 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 307/580] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:29 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:29.410159 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a420322b-0c1f-4d73-a5a6-1cfa6d31bfa1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:29.410888 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a420322b-0c1f-4d73-a5a6-1cfa6d31bfa1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:29.417616 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a420322b-0c1f-4d73-a5a6-1cfa6d31bfa1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:29.418069 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a420322b-0c1f-4d73-a5a6-1cfa6d31bfa1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:29.418841 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a420322b-0c1f-4d73-a5a6-1cfa6d31bfa1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:29.419299 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a420322b-0c1f-4d73-a5a6-1cfa6d31bfa1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:29.567615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:29.568841 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:29.576272 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:29.577036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:29.578011 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:29.578648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:29.595265 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a420322b-0c1f-4d73-a5a6-1cfa6d31bfa1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:29.614556 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a420322b-0c1f-4d73-a5a6-1cfa6d31bfa1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.208279 Aug 19 09:20:29.615138 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 274/581] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:29 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:29.633292 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:29.633746 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:29.634195 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lazy-loading 'fault' on Instance uuid c850e5cb-c98e-487b-941e-5e12784e18aa {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:20:29.681955 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea096a506eb45af9559d4ccc9698673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3fe8da8a104ba2b3e206211030cffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:29.689065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-34ca647a-6d37-43d5-a98c-a07dcfc27a3d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 200 len: 1304 microversion: 2.1 time: 0.125838 Aug 19 09:20:29.690015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 308/582] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:29 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:30.311114 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-615c48e7-fa9b-426f-85b1-35e0c8243eb5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:30.311989 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-615c48e7-fa9b-426f-85b1-35e0c8243eb5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:30.318438 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-615c48e7-fa9b-426f-85b1-35e0c8243eb5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:30.318877 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-615c48e7-fa9b-426f-85b1-35e0c8243eb5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:30.319678 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-615c48e7-fa9b-426f-85b1-35e0c8243eb5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:30.320100 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-615c48e7-fa9b-426f-85b1-35e0c8243eb5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:30.411497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-64a9b865-cbd2-4e2a-ad71-0b5bc7015f95 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:30.412163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-64a9b865-cbd2-4e2a-ad71-0b5bc7015f95 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:30.417924 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64a9b865-cbd2-4e2a-ad71-0b5bc7015f95 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:30.418372 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64a9b865-cbd2-4e2a-ad71-0b5bc7015f95 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:30.419136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64a9b865-cbd2-4e2a-ad71-0b5bc7015f95 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:30.419670 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64a9b865-cbd2-4e2a-ad71-0b5bc7015f95 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:30.437230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-615c48e7-fa9b-426f-85b1-35e0c8243eb5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.129730 Aug 19 09:20:30.437859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 275/583] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:30 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:30.538116 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-64a9b865-cbd2-4e2a-ad71-0b5bc7015f95 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:30.545172 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-64a9b865-cbd2-4e2a-ad71-0b5bc7015f95 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1317 microversion: 2.1 time: 0.137419 Aug 19 09:20:30.545724 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 309/584] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:30 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:30.632652 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1078b81b-e179-4915-a665-33ec221ceb0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:30.633691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1078b81b-e179-4915-a665-33ec221ceb0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:30.640296 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1078b81b-e179-4915-a665-33ec221ceb0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:30.640834 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1078b81b-e179-4915-a665-33ec221ceb0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:30.641606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1078b81b-e179-4915-a665-33ec221ceb0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:30.642039 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1078b81b-e179-4915-a665-33ec221ceb0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:30.705766 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-68fe5a75-5ecd-427b-9c75-95f79f464b9d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:30.706506 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-68fe5a75-5ecd-427b-9c75-95f79f464b9d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] [instance: c850e5cb-c98e-487b-941e-5e12784e18aa] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:30.713331 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68fe5a75-5ecd-427b-9c75-95f79f464b9d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:30.714121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68fe5a75-5ecd-427b-9c75-95f79f464b9d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:30.714996 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68fe5a75-5ecd-427b-9c75-95f79f464b9d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:30.715550 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68fe5a75-5ecd-427b-9c75-95f79f464b9d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:30.731335 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-68fe5a75-5ecd-427b-9c75-95f79f464b9d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] HTTP exception thrown: Instance c850e5cb-c98e-487b-941e-5e12784e18aa could not be found. Aug 19 09:20:30.732018 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-68fe5a75-5ecd-427b-9c75-95f79f464b9d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] Returning 404 to user: Instance c850e5cb-c98e-487b-941e-5e12784e18aa could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:20:30.733403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-68fe5a75-5ecd-427b-9c75-95f79f464b9d tempest-VolumesActionsTest-513049404 tempest-VolumesActionsTest-513049404-project] 10.222.0.32 "GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa" status: 404 len: 111 microversion: 2.1 time: 0.030879 Aug 19 09:20:30.733490 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 310/585] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:30 2021] GET /compute/v2.1/servers/c850e5cb-c98e-487b-941e-5e12784e18aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 09:20:30.774317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1078b81b-e179-4915-a665-33ec221ceb0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:30.782900 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1078b81b-e179-4915-a665-33ec221ceb0a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.154807 Aug 19 09:20:30.783439 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 276/586] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:30 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:31.449016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-93852680-58f8-40fe-a6b1-a3955c8574d5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:31.450044 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-93852680-58f8-40fe-a6b1-a3955c8574d5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:31.456049 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93852680-58f8-40fe-a6b1-a3955c8574d5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:31.456496 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93852680-58f8-40fe-a6b1-a3955c8574d5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:31.457844 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93852680-58f8-40fe-a6b1-a3955c8574d5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:31.458272 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93852680-58f8-40fe-a6b1-a3955c8574d5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:31.562253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3626ad1b-3e59-499d-b174-813c05f88f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:31.562892 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3626ad1b-3e59-499d-b174-813c05f88f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:31.569522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3626ad1b-3e59-499d-b174-813c05f88f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:31.569974 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3626ad1b-3e59-499d-b174-813c05f88f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:31.570746 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3626ad1b-3e59-499d-b174-813c05f88f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:31.571180 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3626ad1b-3e59-499d-b174-813c05f88f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:31.571855 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-93852680-58f8-40fe-a6b1-a3955c8574d5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.126413 Aug 19 09:20:31.572737 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 311/587] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:31 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:31.699177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3626ad1b-3e59-499d-b174-813c05f88f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:31.706316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3626ad1b-3e59-499d-b174-813c05f88f0d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1508 microversion: 2.1 time: 0.147638 Aug 19 09:20:31.706869 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 277/588] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:31 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:31.803843 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3c9381cd-eda1-434d-a97a-c0942f9a74d7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:31.804550 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3c9381cd-eda1-434d-a97a-c0942f9a74d7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:31.810836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c9381cd-eda1-434d-a97a-c0942f9a74d7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:31.811299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c9381cd-eda1-434d-a97a-c0942f9a74d7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:31.812079 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c9381cd-eda1-434d-a97a-c0942f9a74d7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:31.812516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c9381cd-eda1-434d-a97a-c0942f9a74d7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:31.946579 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3c9381cd-eda1-434d-a97a-c0942f9a74d7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:31.954372 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3c9381cd-eda1-434d-a97a-c0942f9a74d7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.155552 Aug 19 09:20:31.954929 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 312/589] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:31 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:32.583353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-50bb21b2-d60f-42ce-a111-30a5a155d972 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:32.584270 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-50bb21b2-d60f-42ce-a111-30a5a155d972 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:32.590031 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-50bb21b2-d60f-42ce-a111-30a5a155d972 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:32.590479 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-50bb21b2-d60f-42ce-a111-30a5a155d972 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:32.591243 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-50bb21b2-d60f-42ce-a111-30a5a155d972 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:32.591730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-50bb21b2-d60f-42ce-a111-30a5a155d972 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:32.971764 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6803b962-e873-4a73-9d26-b8082c259f46 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:32.972404 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6803b962-e873-4a73-9d26-b8082c259f46 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:32.979719 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6803b962-e873-4a73-9d26-b8082c259f46 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:32.980169 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6803b962-e873-4a73-9d26-b8082c259f46 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:32.980928 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6803b962-e873-4a73-9d26-b8082c259f46 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:32.981362 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6803b962-e873-4a73-9d26-b8082c259f46 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:33.119033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6803b962-e873-4a73-9d26-b8082c259f46 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:33.126794 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6803b962-e873-4a73-9d26-b8082c259f46 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.158668 Aug 19 09:20:33.127368 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 313/590] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:32 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:34.144642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1badaa1a-73fd-4b8e-a157-303cadca4e90 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:34.145315 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1badaa1a-73fd-4b8e-a157-303cadca4e90 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:34.151077 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1badaa1a-73fd-4b8e-a157-303cadca4e90 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:34.151552 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1badaa1a-73fd-4b8e-a157-303cadca4e90 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:34.152311 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1badaa1a-73fd-4b8e-a157-303cadca4e90 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:34.152739 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1badaa1a-73fd-4b8e-a157-303cadca4e90 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:34.273393 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1badaa1a-73fd-4b8e-a157-303cadca4e90 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:34.281129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1badaa1a-73fd-4b8e-a157-303cadca4e90 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.140224 Aug 19 09:20:34.281693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 314/591] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:34 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:35.297611 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-45350117-9f4e-4f07-af17-40bd997f0118 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:35.298218 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-45350117-9f4e-4f07-af17-40bd997f0118 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:35.305091 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45350117-9f4e-4f07-af17-40bd997f0118 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:35.305546 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45350117-9f4e-4f07-af17-40bd997f0118 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:35.306459 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45350117-9f4e-4f07-af17-40bd997f0118 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:35.306763 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45350117-9f4e-4f07-af17-40bd997f0118 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:35.433871 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-45350117-9f4e-4f07-af17-40bd997f0118 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:35.442010 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-45350117-9f4e-4f07-af17-40bd997f0118 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.148049 Aug 19 09:20:35.442558 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 315/592] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:35 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:36.458249 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-293ad379-5a48-4ad7-923b-16527827649e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:36.459003 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-293ad379-5a48-4ad7-923b-16527827649e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:36.464593 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-293ad379-5a48-4ad7-923b-16527827649e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:36.465032 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-293ad379-5a48-4ad7-923b-16527827649e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:36.465783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-293ad379-5a48-4ad7-923b-16527827649e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:36.466209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-293ad379-5a48-4ad7-923b-16527827649e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:36.585696 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-293ad379-5a48-4ad7-923b-16527827649e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:36.593291 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-293ad379-5a48-4ad7-923b-16527827649e tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.138601 Aug 19 09:20:36.593953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 316/593] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:36 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:37.603281 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-50bb21b2-d60f-42ce-a111-30a5a155d972 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 5.023618 Aug 19 09:20:37.603966 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 278/594] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:32 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 5025 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:37.610661 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b7a1c2c5-6273-419a-b54f-01c010b69806 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:37.611257 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b7a1c2c5-6273-419a-b54f-01c010b69806 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:37.617264 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b7a1c2c5-6273-419a-b54f-01c010b69806 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:37.617715 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b7a1c2c5-6273-419a-b54f-01c010b69806 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:37.618481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b7a1c2c5-6273-419a-b54f-01c010b69806 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:37.618912 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b7a1c2c5-6273-419a-b54f-01c010b69806 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:37.740487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b7a1c2c5-6273-419a-b54f-01c010b69806 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:37.748728 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b7a1c2c5-6273-419a-b54f-01c010b69806 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.141625 Aug 19 09:20:37.749769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 317/595] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:37 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:38.615642 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5eb6558f-98e3-4c0f-a66a-49b39093ca4f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:38.616813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5eb6558f-98e3-4c0f-a66a-49b39093ca4f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:38.623223 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5eb6558f-98e3-4c0f-a66a-49b39093ca4f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:38.623705 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5eb6558f-98e3-4c0f-a66a-49b39093ca4f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:38.624464 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5eb6558f-98e3-4c0f-a66a-49b39093ca4f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:38.624896 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5eb6558f-98e3-4c0f-a66a-49b39093ca4f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:38.755159 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5eb6558f-98e3-4c0f-a66a-49b39093ca4f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.144246 Aug 19 09:20:38.756085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 279/596] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:38 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:38.765650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5571b923-000b-4900-a408-c0b278991cb9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:38.766397 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5571b923-000b-4900-a408-c0b278991cb9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:38.773115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5571b923-000b-4900-a408-c0b278991cb9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:38.773573 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5571b923-000b-4900-a408-c0b278991cb9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:38.774429 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5571b923-000b-4900-a408-c0b278991cb9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:38.774931 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5571b923-000b-4900-a408-c0b278991cb9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:38.901065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5571b923-000b-4900-a408-c0b278991cb9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:38.908682 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5571b923-000b-4900-a408-c0b278991cb9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.146744 Aug 19 09:20:38.909236 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 318/597] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:38 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:39.363223 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c5f21f60-4320-4bc5-8b09-8e8e0660d04a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c24e7819-e92a-4d9d-b4a3-55314438b0d0"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:39.364378 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c5f21f60-4320-4bc5-8b09-8e8e0660d04a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:39.370700 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c5f21f60-4320-4bc5-8b09-8e8e0660d04a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:39.371145 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c5f21f60-4320-4bc5-8b09-8e8e0660d04a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:39.371957 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c5f21f60-4320-4bc5-8b09-8e8e0660d04a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:39.372384 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c5f21f60-4320-4bc5-8b09-8e8e0660d04a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:39.690911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c5f21f60-4320-4bc5-8b09-8e8e0660d04a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "POST /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331562 Aug 19 09:20:39.696904 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 280/598] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:20:39 2021] POST /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:20:39.768940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f46bba16-538a-4a64-9f1d-aa39f8a787a2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:39.770124 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f46bba16-538a-4a64-9f1d-aa39f8a787a2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:39.785743 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f46bba16-538a-4a64-9f1d-aa39f8a787a2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:39.788445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f46bba16-538a-4a64-9f1d-aa39f8a787a2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:39.789601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f46bba16-538a-4a64-9f1d-aa39f8a787a2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:39.790107 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f46bba16-538a-4a64-9f1d-aa39f8a787a2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:39.926459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-38e49578-4fd9-49c6-8de2-ed2048084065 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:39.931651 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f46bba16-538a-4a64-9f1d-aa39f8a787a2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.167040 Aug 19 09:20:39.932932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 319/599] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:39 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:20:39.939455 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-38e49578-4fd9-49c6-8de2-ed2048084065 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:39.946204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38e49578-4fd9-49c6-8de2-ed2048084065 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:39.946863 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38e49578-4fd9-49c6-8de2-ed2048084065 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:39.947917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38e49578-4fd9-49c6-8de2-ed2048084065 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:39.948763 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38e49578-4fd9-49c6-8de2-ed2048084065 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:40.084485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-38e49578-4fd9-49c6-8de2-ed2048084065 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:40.092131 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-38e49578-4fd9-49c6-8de2-ed2048084065 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.169850 Aug 19 09:20:40.092687 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 281/600] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:39 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:40.944240 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a6e44599-d7f6-4de1-90e0-76753d74898d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:40.945130 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a6e44599-d7f6-4de1-90e0-76753d74898d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:40.952121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a6e44599-d7f6-4de1-90e0-76753d74898d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:40.952823 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a6e44599-d7f6-4de1-90e0-76753d74898d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:40.953593 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a6e44599-d7f6-4de1-90e0-76753d74898d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:40.954030 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a6e44599-d7f6-4de1-90e0-76753d74898d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:41.058599 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a6e44599-d7f6-4de1-90e0-76753d74898d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.118975 Aug 19 09:20:41.059698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 320/601] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:40 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:41.109714 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9ef14574-166b-45b7-827a-69fca9f0fbf1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:41.110424 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9ef14574-166b-45b7-827a-69fca9f0fbf1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:41.117352 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ef14574-166b-45b7-827a-69fca9f0fbf1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:41.117790 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ef14574-166b-45b7-827a-69fca9f0fbf1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:41.118549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ef14574-166b-45b7-827a-69fca9f0fbf1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:41.118975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ef14574-166b-45b7-827a-69fca9f0fbf1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:41.261371 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9ef14574-166b-45b7-827a-69fca9f0fbf1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:41.269358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9ef14574-166b-45b7-827a-69fca9f0fbf1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.163321 Aug 19 09:20:41.270093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 282/602] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:41 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:42.075659 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5b4b98ac-0aa9-4ac9-b735-0f7c281a9042 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:42.077536 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5b4b98ac-0aa9-4ac9-b735-0f7c281a9042 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:42.086762 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5b4b98ac-0aa9-4ac9-b735-0f7c281a9042 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:42.087218 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5b4b98ac-0aa9-4ac9-b735-0f7c281a9042 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:42.088275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5b4b98ac-0aa9-4ac9-b735-0f7c281a9042 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:42.088701 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5b4b98ac-0aa9-4ac9-b735-0f7c281a9042 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:42.195313 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5b4b98ac-0aa9-4ac9-b735-0f7c281a9042 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.124041 Aug 19 09:20:42.196471 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 321/603] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:42 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:42.287534 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-671dc27f-562a-44f1-81f2-06c1d5030789 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:42.288152 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-671dc27f-562a-44f1-81f2-06c1d5030789 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:42.294154 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-671dc27f-562a-44f1-81f2-06c1d5030789 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:42.294635 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-671dc27f-562a-44f1-81f2-06c1d5030789 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:42.295616 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-671dc27f-562a-44f1-81f2-06c1d5030789 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:42.296050 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-671dc27f-562a-44f1-81f2-06c1d5030789 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:42.444783 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-671dc27f-562a-44f1-81f2-06c1d5030789 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:42.453090 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-671dc27f-562a-44f1-81f2-06c1d5030789 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.169736 Aug 19 09:20:42.453981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 283/604] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:42 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:43.206921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3d7af673-c9d4-4f06-a97b-032ec6689e46 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:43.207946 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3d7af673-c9d4-4f06-a97b-032ec6689e46 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:43.214834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d7af673-c9d4-4f06-a97b-032ec6689e46 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:43.215298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d7af673-c9d4-4f06-a97b-032ec6689e46 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:43.216058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d7af673-c9d4-4f06-a97b-032ec6689e46 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:43.216486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d7af673-c9d4-4f06-a97b-032ec6689e46 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:43.306848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3d7af673-c9d4-4f06-a97b-032ec6689e46 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.103738 Aug 19 09:20:43.307762 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 322/605] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:43 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:43.470226 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f535e07e-0957-4615-8600-b05adc7b264a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:43.470810 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f535e07e-0957-4615-8600-b05adc7b264a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:43.478048 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f535e07e-0957-4615-8600-b05adc7b264a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:43.478489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f535e07e-0957-4615-8600-b05adc7b264a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:43.479247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f535e07e-0957-4615-8600-b05adc7b264a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:43.479741 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f535e07e-0957-4615-8600-b05adc7b264a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:43.609008 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f535e07e-0957-4615-8600-b05adc7b264a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:43.617234 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f535e07e-0957-4615-8600-b05adc7b264a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.150777 Aug 19 09:20:43.617795 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 284/606] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:43 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:44.319223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c05cb4da-c4d2-4533-9083-70f08a891f06 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:44.320154 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c05cb4da-c4d2-4533-9083-70f08a891f06 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:44.326536 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c05cb4da-c4d2-4533-9083-70f08a891f06 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:44.326945 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c05cb4da-c4d2-4533-9083-70f08a891f06 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:44.327729 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c05cb4da-c4d2-4533-9083-70f08a891f06 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:44.328154 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c05cb4da-c4d2-4533-9083-70f08a891f06 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:44.435837 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c05cb4da-c4d2-4533-9083-70f08a891f06 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.120946 Aug 19 09:20:44.437287 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 323/607] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:44 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:44.633781 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-58fa23a5-9417-4a3f-9535-7dd862c2301a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:44.634390 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-58fa23a5-9417-4a3f-9535-7dd862c2301a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:44.647045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-58fa23a5-9417-4a3f-9535-7dd862c2301a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:44.647835 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-58fa23a5-9417-4a3f-9535-7dd862c2301a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:44.648470 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-58fa23a5-9417-4a3f-9535-7dd862c2301a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:44.648975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-58fa23a5-9417-4a3f-9535-7dd862c2301a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:44.774899 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-58fa23a5-9417-4a3f-9535-7dd862c2301a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:44.783684 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-58fa23a5-9417-4a3f-9535-7dd862c2301a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.153973 Aug 19 09:20:44.793824 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 285/608] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:44 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:45.450642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-df16d4ab-6e65-4607-b467-27c3162d0fb9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:45.452831 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-df16d4ab-6e65-4607-b467-27c3162d0fb9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:45.462213 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-df16d4ab-6e65-4607-b467-27c3162d0fb9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:45.462672 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-df16d4ab-6e65-4607-b467-27c3162d0fb9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:45.463466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-df16d4ab-6e65-4607-b467-27c3162d0fb9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:45.464015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-df16d4ab-6e65-4607-b467-27c3162d0fb9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:45.569153 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-df16d4ab-6e65-4607-b467-27c3162d0fb9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.124097 Aug 19 09:20:45.570088 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 324/609] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:45 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:45.801803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ffd18b35-ddd2-4af7-abbd-4c626d15db05 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:45.802566 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ffd18b35-ddd2-4af7-abbd-4c626d15db05 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:45.809359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ffd18b35-ddd2-4af7-abbd-4c626d15db05 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:45.809850 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ffd18b35-ddd2-4af7-abbd-4c626d15db05 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:45.810747 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ffd18b35-ddd2-4af7-abbd-4c626d15db05 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:45.811180 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ffd18b35-ddd2-4af7-abbd-4c626d15db05 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:45.942102 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ffd18b35-ddd2-4af7-abbd-4c626d15db05 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:45.950908 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ffd18b35-ddd2-4af7-abbd-4c626d15db05 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.153323 Aug 19 09:20:45.961409 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 286/610] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:45 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:46.581957 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-58faeaf2-e681-4689-9bed-20f2a84e3c4c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:46.583059 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-58faeaf2-e681-4689-9bed-20f2a84e3c4c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:46.589734 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58faeaf2-e681-4689-9bed-20f2a84e3c4c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:46.590181 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58faeaf2-e681-4689-9bed-20f2a84e3c4c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:46.590942 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58faeaf2-e681-4689-9bed-20f2a84e3c4c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:46.591410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58faeaf2-e681-4689-9bed-20f2a84e3c4c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:46.699880 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-58faeaf2-e681-4689-9bed-20f2a84e3c4c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.121878 Aug 19 09:20:46.700756 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 325/611] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:46 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:46.968979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-77f8845a-d3b3-44b3-b537-6bcd3e7db034 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:46.970217 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-77f8845a-d3b3-44b3-b537-6bcd3e7db034 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:46.976697 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-77f8845a-d3b3-44b3-b537-6bcd3e7db034 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:46.977347 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-77f8845a-d3b3-44b3-b537-6bcd3e7db034 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:46.978116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-77f8845a-d3b3-44b3-b537-6bcd3e7db034 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:46.978545 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-77f8845a-d3b3-44b3-b537-6bcd3e7db034 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:47.117199 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-77f8845a-d3b3-44b3-b537-6bcd3e7db034 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:47.125291 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-77f8845a-d3b3-44b3-b537-6bcd3e7db034 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.160157 Aug 19 09:20:47.125939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 287/612] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:46 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:47.713424 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fc530318-1fdf-4aa1-b3d0-b8e0e7a8967f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:47.714587 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fc530318-1fdf-4aa1-b3d0-b8e0e7a8967f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:47.721657 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fc530318-1fdf-4aa1-b3d0-b8e0e7a8967f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:47.722345 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fc530318-1fdf-4aa1-b3d0-b8e0e7a8967f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:47.723123 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fc530318-1fdf-4aa1-b3d0-b8e0e7a8967f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:47.723845 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fc530318-1fdf-4aa1-b3d0-b8e0e7a8967f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:47.819423 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fc530318-1fdf-4aa1-b3d0-b8e0e7a8967f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.111005 Aug 19 09:20:47.821083 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 326/613] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:47 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:48.143140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-872e5286-2d6b-428b-a7e5-1319bb653405 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:48.143883 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-872e5286-2d6b-428b-a7e5-1319bb653405 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:48.151401 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-872e5286-2d6b-428b-a7e5-1319bb653405 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:48.151853 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-872e5286-2d6b-428b-a7e5-1319bb653405 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:48.152623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-872e5286-2d6b-428b-a7e5-1319bb653405 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:48.153054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-872e5286-2d6b-428b-a7e5-1319bb653405 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:48.291997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-872e5286-2d6b-428b-a7e5-1319bb653405 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:48.300861 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-872e5286-2d6b-428b-a7e5-1319bb653405 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.161231 Aug 19 09:20:48.301675 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 288/614] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:48 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:48.407123 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2415789d-8f8a-4581-8f4a-5d38f99bb194 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c24e7819-e92a-4d9d-b4a3-55314438b0d0"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:48.408373 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2415789d-8f8a-4581-8f4a-5d38f99bb194 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:48.416241 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2415789d-8f8a-4581-8f4a-5d38f99bb194 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:48.416849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2415789d-8f8a-4581-8f4a-5d38f99bb194 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:48.417824 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2415789d-8f8a-4581-8f4a-5d38f99bb194 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:48.418589 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2415789d-8f8a-4581-8f4a-5d38f99bb194 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:48.588969 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-2415789d-8f8a-4581-8f4a-5d38f99bb194 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] HTTP exception thrown: Invalid volume: volume c24e7819-e92a-4d9d-b4a3-55314438b0d0 is already attached to instances: 770a9eff-164f-464b-9ddc-85d731650432 Aug 19 09:20:48.589606 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2415789d-8f8a-4581-8f4a-5d38f99bb194 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Returning 400 to user: Invalid volume: volume c24e7819-e92a-4d9d-b4a3-55314438b0d0 is already attached to instances: 770a9eff-164f-464b-9ddc-85d731650432 {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:20:48.590445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2415789d-8f8a-4581-8f4a-5d38f99bb194 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "POST /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.187570 Aug 19 09:20:48.591033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 327/615] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:20:48 2021] POST /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments => generated 174 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 19 09:20:48.665777 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-88af4441-9051-4844-bf72-9f8eaf0cdfb5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:48.666696 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-88af4441-9051-4844-bf72-9f8eaf0cdfb5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:48.672988 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88af4441-9051-4844-bf72-9f8eaf0cdfb5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:48.673565 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88af4441-9051-4844-bf72-9f8eaf0cdfb5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:48.674477 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88af4441-9051-4844-bf72-9f8eaf0cdfb5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:48.675699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88af4441-9051-4844-bf72-9f8eaf0cdfb5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:48.778513 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-88af4441-9051-4844-bf72-9f8eaf0cdfb5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lazy-loading 'services' on Instance uuid 770a9eff-164f-464b-9ddc-85d731650432 {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:20:48.832890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e0d73540-b7eb-4535-85f1-982e92e41d94 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:48.836113 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e0d73540-b7eb-4535-85f1-982e92e41d94 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:48.843964 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0d73540-b7eb-4535-85f1-982e92e41d94 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:48.844821 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0d73540-b7eb-4535-85f1-982e92e41d94 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:48.845753 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0d73540-b7eb-4535-85f1-982e92e41d94 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:48.846337 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0d73540-b7eb-4535-85f1-982e92e41d94 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:48.856855 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-88af4441-9051-4844-bf72-9f8eaf0cdfb5 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "DELETE /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments/c24e7819-e92a-4d9d-b4a3-55314438b0d0" status: 202 len: 0 microversion: 2.1 time: 0.194507 Aug 19 09:20:48.861355 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 289/616] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:20:48 2021] DELETE /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments/c24e7819-e92a-4d9d-b4a3-55314438b0d0 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:48.872976 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8c56d319-3464-4013-a2c1-827b25063c26 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:48.874298 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8c56d319-3464-4013-a2c1-827b25063c26 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:48.883477 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8c56d319-3464-4013-a2c1-827b25063c26 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:48.884062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8c56d319-3464-4013-a2c1-827b25063c26 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:48.884845 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8c56d319-3464-4013-a2c1-827b25063c26 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:48.885315 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8c56d319-3464-4013-a2c1-827b25063c26 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:48.920537 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8c56d319-3464-4013-a2c1-827b25063c26 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057838 Aug 19 09:20:48.921406 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 290/617] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:20:48 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:20:48.981491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e0d73540-b7eb-4535-85f1-982e92e41d94 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.152884 Aug 19 09:20:48.981937 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 328/618] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:48 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:20:49.318593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bf0baced-0232-4c62-a941-e2bc34637980 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:49.319436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bf0baced-0232-4c62-a941-e2bc34637980 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:49.326646 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bf0baced-0232-4c62-a941-e2bc34637980 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:49.327441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bf0baced-0232-4c62-a941-e2bc34637980 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:49.328545 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bf0baced-0232-4c62-a941-e2bc34637980 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:49.329053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bf0baced-0232-4c62-a941-e2bc34637980 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:49.469697 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bf0baced-0232-4c62-a941-e2bc34637980 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:49.478041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bf0baced-0232-4c62-a941-e2bc34637980 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.163793 Aug 19 09:20:49.478599 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 291/619] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:49 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:49.934028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-64923729-d4bf-43f2-b344-f899a5a4e859 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:49.935023 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-64923729-d4bf-43f2-b344-f899a5a4e859 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:49.942120 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64923729-d4bf-43f2-b344-f899a5a4e859 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:49.942598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64923729-d4bf-43f2-b344-f899a5a4e859 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:49.943400 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64923729-d4bf-43f2-b344-f899a5a4e859 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:49.943834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64923729-d4bf-43f2-b344-f899a5a4e859 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:49.972935 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-64923729-d4bf-43f2-b344-f899a5a4e859 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042910 Aug 19 09:20:49.973393 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 329/620] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:20:49 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:20:49.992862 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b57ee9af-cead-4dab-83b9-7e1e59fdc82d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:49.993953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b57ee9af-cead-4dab-83b9-7e1e59fdc82d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:49.999724 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b57ee9af-cead-4dab-83b9-7e1e59fdc82d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:50.000241 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b57ee9af-cead-4dab-83b9-7e1e59fdc82d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:50.001045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b57ee9af-cead-4dab-83b9-7e1e59fdc82d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:50.001405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b57ee9af-cead-4dab-83b9-7e1e59fdc82d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:50.114025 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b57ee9af-cead-4dab-83b9-7e1e59fdc82d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.124697 Aug 19 09:20:50.116255 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 292/621] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:49 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:50.494777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-94c36022-ce44-4f7f-8c6f-6610e96f1872 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:50.495309 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-94c36022-ce44-4f7f-8c6f-6610e96f1872 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:50.501455 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-94c36022-ce44-4f7f-8c6f-6610e96f1872 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:50.502161 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-94c36022-ce44-4f7f-8c6f-6610e96f1872 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:50.502968 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-94c36022-ce44-4f7f-8c6f-6610e96f1872 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:50.503466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-94c36022-ce44-4f7f-8c6f-6610e96f1872 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:50.635358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-94c36022-ce44-4f7f-8c6f-6610e96f1872 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:50.646481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-94c36022-ce44-4f7f-8c6f-6610e96f1872 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.155476 Aug 19 09:20:50.647993 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 330/622] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:50 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:50.986181 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a3e7836d-a1dd-484f-8900-6964f0e91fc7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:50.987165 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a3e7836d-a1dd-484f-8900-6964f0e91fc7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:50.993425 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a3e7836d-a1dd-484f-8900-6964f0e91fc7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:50.993869 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a3e7836d-a1dd-484f-8900-6964f0e91fc7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:50.994631 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a3e7836d-a1dd-484f-8900-6964f0e91fc7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:50.995052 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a3e7836d-a1dd-484f-8900-6964f0e91fc7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:51.024718 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a3e7836d-a1dd-484f-8900-6964f0e91fc7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042307 Aug 19 09:20:51.025484 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 293/623] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:20:50 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:20:51.126319 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5263451b-e0f2-4071-b1fd-667dd3f329b4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:51.127429 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5263451b-e0f2-4071-b1fd-667dd3f329b4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:51.133851 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5263451b-e0f2-4071-b1fd-667dd3f329b4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:51.134394 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5263451b-e0f2-4071-b1fd-667dd3f329b4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:51.135250 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5263451b-e0f2-4071-b1fd-667dd3f329b4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:51.135803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5263451b-e0f2-4071-b1fd-667dd3f329b4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:51.195198 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1287624699", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "networks": [{"uuid": "5e78b5e6-6e38-4b51-a3a6-7fec0d074363"}]}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:51.245834 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] validate_networks() for [('5e78b5e6-6e38-4b51-a3a6-7fec0d074363', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:20:51.256329 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5263451b-e0f2-4071-b1fd-667dd3f329b4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.133578 Aug 19 09:20:51.257058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 331/624] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:51 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:51.626047 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:20:51.626470 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:20:51.626935 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:20:51.627376 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:20:51.627784 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:20:51.636626 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:51.637066 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:51.637851 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:51.638273 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:51.655139 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Getting quotas for project 8bd62739089241319075c92d0306a0a3. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:20:51.658994 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Getting quotas for user bfa387ffa6784561956f39df611dfab4 and project 8bd62739089241319075c92d0306a0a3. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:20:51.665210 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-76a9585c-fda9-43e7-b1ec-b71b6e4ee911 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:51.666080 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-76a9585c-fda9-43e7-b1ec-b71b6e4ee911 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:51.672385 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:20:51.674082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-76a9585c-fda9-43e7-b1ec-b71b6e4ee911 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:51.674538 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-76a9585c-fda9-43e7-b1ec-b71b6e4ee911 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:51.675332 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-76a9585c-fda9-43e7-b1ec-b71b6e4ee911 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:51.675762 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-76a9585c-fda9-43e7-b1ec-b71b6e4ee911 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:51.678441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:20:51.737129 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-612f392e-39a6-4438-9c63-abb5af883f8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545837 Aug 19 09:20:51.743634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 294/625] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:20:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 09:20:51.748107 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f185f3bc-e82f-4cbc-8891-5c0a39b1559f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:51.748885 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f185f3bc-e82f-4cbc-8891-5c0a39b1559f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:51.809925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f185f3bc-e82f-4cbc-8891-5c0a39b1559f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:51.816837 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f185f3bc-e82f-4cbc-8891-5c0a39b1559f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1218 microversion: 2.1 time: 0.072212 Aug 19 09:20:51.819740 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 295/626] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:51 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:51.832146 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-76a9585c-fda9-43e7-b1ec-b71b6e4ee911 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:51.841026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-76a9585c-fda9-43e7-b1ec-b71b6e4ee911 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.179911 Aug 19 09:20:51.842126 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 332/627] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:51 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:52.268431 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7b306898-a3f8-422f-aa27-594cbd32ecd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:52.270028 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7b306898-a3f8-422f-aa27-594cbd32ecd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:52.277697 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b306898-a3f8-422f-aa27-594cbd32ecd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:52.278376 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b306898-a3f8-422f-aa27-594cbd32ecd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:52.279364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b306898-a3f8-422f-aa27-594cbd32ecd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:52.279804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b306898-a3f8-422f-aa27-594cbd32ecd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:52.507153 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7b306898-a3f8-422f-aa27-594cbd32ecd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.242274 Aug 19 09:20:52.508078 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 296/628] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:52 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:52.835410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ebfd11ee-54c8-4a98-a97b-a92e9ce16ad1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:52.836142 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ebfd11ee-54c8-4a98-a97b-a92e9ce16ad1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:52.846004 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ebfd11ee-54c8-4a98-a97b-a92e9ce16ad1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:52.846459 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ebfd11ee-54c8-4a98-a97b-a92e9ce16ad1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:52.847235 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ebfd11ee-54c8-4a98-a97b-a92e9ce16ad1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:52.847695 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ebfd11ee-54c8-4a98-a97b-a92e9ce16ad1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:52.858281 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-01af3536-4464-4924-a589-168aeac3fda3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:52.858864 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-01af3536-4464-4924-a589-168aeac3fda3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:52.865451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01af3536-4464-4924-a589-168aeac3fda3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:52.866854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01af3536-4464-4924-a589-168aeac3fda3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:52.868056 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01af3536-4464-4924-a589-168aeac3fda3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:52.868704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01af3536-4464-4924-a589-168aeac3fda3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:52.899421 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:20:52.899876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:20:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df (ip 10.222.0.32) !!! Aug 19 09:20:52.933227 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ebfd11ee-54c8-4a98-a97b-a92e9ce16ad1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:52.941050 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ebfd11ee-54c8-4a98-a97b-a92e9ce16ad1 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1270 microversion: 2.1 time: 0.110129 Aug 19 09:20:52.951482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 333/629] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:52 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:53.021895 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-01af3536-4464-4924-a589-168aeac3fda3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:53.031492 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-01af3536-4464-4924-a589-168aeac3fda3 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.177157 Aug 19 09:20:53.032074 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 297/630] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:52 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:53.518563 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-01e77df9-5cda-4655-b3b1-339589ae82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:53.520010 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-01e77df9-5cda-4655-b3b1-339589ae82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:53.533775 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01e77df9-5cda-4655-b3b1-339589ae82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:53.534478 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01e77df9-5cda-4655-b3b1-339589ae82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:53.535465 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01e77df9-5cda-4655-b3b1-339589ae82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:53.536710 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01e77df9-5cda-4655-b3b1-339589ae82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:53.696913 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-01e77df9-5cda-4655-b3b1-339589ae82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.173925 Aug 19 09:20:53.697753 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 334/631] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:53 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:53.959394 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9dacbcdf-e511-4f75-a28c-11e2ae3ebb58 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:53.960651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9dacbcdf-e511-4f75-a28c-11e2ae3ebb58 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:53.967755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9dacbcdf-e511-4f75-a28c-11e2ae3ebb58 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:53.967997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9dacbcdf-e511-4f75-a28c-11e2ae3ebb58 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:53.969024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9dacbcdf-e511-4f75-a28c-11e2ae3ebb58 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:53.969613 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9dacbcdf-e511-4f75-a28c-11e2ae3ebb58 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:54.052986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e372a15b-b491-4030-8a99-83da986b7bd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:54.054680 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e372a15b-b491-4030-8a99-83da986b7bd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:54.063519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e372a15b-b491-4030-8a99-83da986b7bd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:54.064341 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e372a15b-b491-4030-8a99-83da986b7bd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:54.065440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e372a15b-b491-4030-8a99-83da986b7bd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:54.065875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e372a15b-b491-4030-8a99-83da986b7bd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:54.102313 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9dacbcdf-e511-4f75-a28c-11e2ae3ebb58 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:54.117422 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9dacbcdf-e511-4f75-a28c-11e2ae3ebb58 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1276 microversion: 2.1 time: 0.162077 Aug 19 09:20:54.132416 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 298/632] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:53 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:54.239970 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e372a15b-b491-4030-8a99-83da986b7bd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:54.250168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e372a15b-b491-4030-8a99-83da986b7bd9 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.204953 Aug 19 09:20:54.261670 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 335/633] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:54 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:54.709313 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-700d0d0e-a91a-4bff-bb65-0f13f1c1e6e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:54.710245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-700d0d0e-a91a-4bff-bb65-0f13f1c1e6e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:54.725253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-700d0d0e-a91a-4bff-bb65-0f13f1c1e6e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:54.725942 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-700d0d0e-a91a-4bff-bb65-0f13f1c1e6e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:54.726896 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-700d0d0e-a91a-4bff-bb65-0f13f1c1e6e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:54.727511 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-700d0d0e-a91a-4bff-bb65-0f13f1c1e6e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:54.866633 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-700d0d0e-a91a-4bff-bb65-0f13f1c1e6e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.161337 Aug 19 09:20:54.872485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 299/634] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:54 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:55.138297 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e97892d5-1dc5-4f1d-9790-02fd416ab25a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:55.138843 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e97892d5-1dc5-4f1d-9790-02fd416ab25a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:55.148339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e97892d5-1dc5-4f1d-9790-02fd416ab25a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:55.148783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e97892d5-1dc5-4f1d-9790-02fd416ab25a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:55.149557 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e97892d5-1dc5-4f1d-9790-02fd416ab25a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:55.149986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e97892d5-1dc5-4f1d-9790-02fd416ab25a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:55.229316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-8b6a59c1-30cf-4432-add0-e8169184585e req-352a4d4e-aeb2-415f-9b6d-5b62743ee1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7db7988b-5e66-43cd-8e4a-d32b1b29786b", "tag": "a75a2d3b-a5ee-46a2-88d4-3c5ae8cb26fb"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:55.230801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:20:55.230801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:20:55.244499 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-8b6a59c1-30cf-4432-add0-e8169184585e req-352a4d4e-aeb2-415f-9b6d-5b62743ee1dc service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:55.245006 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-8b6a59c1-30cf-4432-add0-e8169184585e req-352a4d4e-aeb2-415f-9b6d-5b62743ee1dc service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:55.265652 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-8b6a59c1-30cf-4432-add0-e8169184585e req-352a4d4e-aeb2-415f-9b6d-5b62743ee1dc service nova] Creating event network-changed:a75a2d3b-a5ee-46a2-88d4-3c5ae8cb26fb for instance 7db7988b-5e66-43cd-8e4a-d32b1b29786b on hv-cinder-77387 Aug 19 09:20:55.271924 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-8b6a59c1-30cf-4432-add0-e8169184585e req-352a4d4e-aeb2-415f-9b6d-5b62743ee1dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046274 Aug 19 09:20:55.272522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 300/635] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:20:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:20:55.278169 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9d22809b-4db5-42f9-8a77-867524e344c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:55.278874 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9d22809b-4db5-42f9-8a77-867524e344c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:55.285245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d22809b-4db5-42f9-8a77-867524e344c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:55.285805 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d22809b-4db5-42f9-8a77-867524e344c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:55.287501 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d22809b-4db5-42f9-8a77-867524e344c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:55.288031 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d22809b-4db5-42f9-8a77-867524e344c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:55.312531 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e97892d5-1dc5-4f1d-9790-02fd416ab25a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:55.334421 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e97892d5-1dc5-4f1d-9790-02fd416ab25a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.200751 Aug 19 09:20:55.334977 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 336/636] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:55 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:55.457066 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9d22809b-4db5-42f9-8a77-867524e344c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:55.466472 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9d22809b-4db5-42f9-8a77-867524e344c8 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.192838 Aug 19 09:20:55.467119 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 301/637] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:55 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:55.882881 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d6831702-7143-4129-934e-23ee854c8c32 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:55.884660 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d6831702-7143-4129-934e-23ee854c8c32 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:55.893014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d6831702-7143-4129-934e-23ee854c8c32 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:55.893595 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d6831702-7143-4129-934e-23ee854c8c32 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:55.894504 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d6831702-7143-4129-934e-23ee854c8c32 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:55.895022 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d6831702-7143-4129-934e-23ee854c8c32 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:56.189517 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d6831702-7143-4129-934e-23ee854c8c32 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.313272 Aug 19 09:20:56.198122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 337/638] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:55 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:56.351440 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9aa0f523-9615-46a5-8694-fdea1cea81e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:56.352047 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9aa0f523-9615-46a5-8694-fdea1cea81e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:56.360361 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9aa0f523-9615-46a5-8694-fdea1cea81e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:56.360876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9aa0f523-9615-46a5-8694-fdea1cea81e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:56.361659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9aa0f523-9615-46a5-8694-fdea1cea81e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:56.362092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9aa0f523-9615-46a5-8694-fdea1cea81e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:56.486612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9a5add3f-2d0f-4141-8e74-01ee332f6c45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:56.487331 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9a5add3f-2d0f-4141-8e74-01ee332f6c45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:56.499719 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9a5add3f-2d0f-4141-8e74-01ee332f6c45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:56.500163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9a5add3f-2d0f-4141-8e74-01ee332f6c45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:56.512323 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9a5add3f-2d0f-4141-8e74-01ee332f6c45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:56.513001 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9a5add3f-2d0f-4141-8e74-01ee332f6c45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:56.621013 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9aa0f523-9615-46a5-8694-fdea1cea81e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:56.628737 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9aa0f523-9615-46a5-8694-fdea1cea81e9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.281495 Aug 19 09:20:56.632025 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 302/639] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:56 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:56.669628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9a5add3f-2d0f-4141-8e74-01ee332f6c45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:56.678696 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9a5add3f-2d0f-4141-8e74-01ee332f6c45 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1569 microversion: 2.1 time: 0.198452 Aug 19 09:20:56.680731 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 338/640] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:56 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:57.208158 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2793d5f6-7633-4d42-a1f8-fca132fd856d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:57.209100 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2793d5f6-7633-4d42-a1f8-fca132fd856d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:57.214978 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2793d5f6-7633-4d42-a1f8-fca132fd856d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:57.215660 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2793d5f6-7633-4d42-a1f8-fca132fd856d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:57.216607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2793d5f6-7633-4d42-a1f8-fca132fd856d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:57.217041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2793d5f6-7633-4d42-a1f8-fca132fd856d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:57.535788 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2793d5f6-7633-4d42-a1f8-fca132fd856d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.331034 Aug 19 09:20:57.538460 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 303/641] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:57 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:57.648108 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-814dd6fe-d6b6-4d6d-a652-cbdb5dbc4256 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:57.649742 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-814dd6fe-d6b6-4d6d-a652-cbdb5dbc4256 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:57.657349 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-814dd6fe-d6b6-4d6d-a652-cbdb5dbc4256 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:57.657916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-814dd6fe-d6b6-4d6d-a652-cbdb5dbc4256 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:57.658904 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-814dd6fe-d6b6-4d6d-a652-cbdb5dbc4256 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:57.659545 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-814dd6fe-d6b6-4d6d-a652-cbdb5dbc4256 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:57.698239 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f680d3ec-ffe7-49ee-b9e4-a333a1ee0ecf tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:57.699200 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f680d3ec-ffe7-49ee-b9e4-a333a1ee0ecf tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:57.710517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f680d3ec-ffe7-49ee-b9e4-a333a1ee0ecf tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:57.711242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f680d3ec-ffe7-49ee-b9e4-a333a1ee0ecf tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:57.712213 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f680d3ec-ffe7-49ee-b9e4-a333a1ee0ecf tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:57.712813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f680d3ec-ffe7-49ee-b9e4-a333a1ee0ecf tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:57.868129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-814dd6fe-d6b6-4d6d-a652-cbdb5dbc4256 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:57.878389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-814dd6fe-d6b6-4d6d-a652-cbdb5dbc4256 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.231738 Aug 19 09:20:57.879010 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 339/642] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:57 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:20:57.914249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f680d3ec-ffe7-49ee-b9e4-a333a1ee0ecf tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:57.922151 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f680d3ec-ffe7-49ee-b9e4-a333a1ee0ecf tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1549 microversion: 2.1 time: 0.227961 Aug 19 09:20:57.923012 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 304/643] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:57 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:57.938387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d93dc589-eac6-4a9a-aea6-8543a4bf514d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:57.938965 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d93dc589-eac6-4a9a-aea6-8543a4bf514d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:57.947796 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d93dc589-eac6-4a9a-aea6-8543a4bf514d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:57.948483 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d93dc589-eac6-4a9a-aea6-8543a4bf514d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:57.949427 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d93dc589-eac6-4a9a-aea6-8543a4bf514d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:57.950021 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d93dc589-eac6-4a9a-aea6-8543a4bf514d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:58.091914 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-d93dc589-eac6-4a9a-aea6-8543a4bf514d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] HTTP exception thrown: Cannot 'detach_volume' instance f4c3bc8f-45ae-4a40-8a3d-d9642d8728df while it is in vm_state rescued Aug 19 09:20:58.092943 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d93dc589-eac6-4a9a-aea6-8543a4bf514d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Returning 409 to user: Cannot 'detach_volume' instance f4c3bc8f-45ae-4a40-8a3d-d9642d8728df while it is in vm_state rescued {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:20:58.093975 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d93dc589-eac6-4a9a-aea6-8543a4bf514d tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments/b28d81c0-49ea-40ca-b1b8-049f29372e17" status: 409 len: 152 microversion: 2.1 time: 0.159389 Aug 19 09:20:58.094914 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 340/644] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:20:57 2021] DELETE /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments/b28d81c0-49ea-40ca-b1b8-049f29372e17 => generated 152 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 19 09:20:58.104466 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a94ab07f-3bc2-4e1b-b9ea-9d8dccab39ce tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:58.105252 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a94ab07f-3bc2-4e1b-b9ea-9d8dccab39ce tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:58.111421 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a94ab07f-3bc2-4e1b-b9ea-9d8dccab39ce tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:58.112249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a94ab07f-3bc2-4e1b-b9ea-9d8dccab39ce tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:58.113218 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a94ab07f-3bc2-4e1b-b9ea-9d8dccab39ce tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:58.113737 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a94ab07f-3bc2-4e1b-b9ea-9d8dccab39ce tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:58.187782 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a94ab07f-3bc2-4e1b-b9ea-9d8dccab39ce tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/action" status: 202 len: 0 microversion: 2.1 time: 0.087892 Aug 19 09:20:58.188693 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 305/645] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:20:58 2021] POST /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:58.196400 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-959d0c3d-9c98-4322-a5c9-34f478a00210 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:58.197143 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-959d0c3d-9c98-4322-a5c9-34f478a00210 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:58.204015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-959d0c3d-9c98-4322-a5c9-34f478a00210 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:58.204755 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-959d0c3d-9c98-4322-a5c9-34f478a00210 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:58.205750 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-959d0c3d-9c98-4322-a5c9-34f478a00210 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:58.206365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-959d0c3d-9c98-4322-a5c9-34f478a00210 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:58.353346 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-959d0c3d-9c98-4322-a5c9-34f478a00210 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:58.366705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-959d0c3d-9c98-4322-a5c9-34f478a00210 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1557 microversion: 2.1 time: 0.173700 Aug 19 09:20:58.368009 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 341/646] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:58 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:58.549111 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cccca3de-3a24-4267-ab4c-4efc787f8da7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:58.550800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-cccca3de-3a24-4267-ab4c-4efc787f8da7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:58.559607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cccca3de-3a24-4267-ab4c-4efc787f8da7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:58.561958 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cccca3de-3a24-4267-ab4c-4efc787f8da7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:58.566043 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cccca3de-3a24-4267-ab4c-4efc787f8da7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:58.566681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cccca3de-3a24-4267-ab4c-4efc787f8da7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:58.703490 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-cccca3de-3a24-4267-ab4c-4efc787f8da7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.158346 Aug 19 09:20:58.704800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 306/647] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:58 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:20:58.897642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-43045dfd-6daf-4933-b56f-86005b3b0592 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:58.898749 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-43045dfd-6daf-4933-b56f-86005b3b0592 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:58.907539 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-43045dfd-6daf-4933-b56f-86005b3b0592 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:58.911918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-43045dfd-6daf-4933-b56f-86005b3b0592 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:58.911918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-43045dfd-6daf-4933-b56f-86005b3b0592 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:58.911918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-43045dfd-6daf-4933-b56f-86005b3b0592 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:59.088730 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-43045dfd-6daf-4933-b56f-86005b3b0592 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:59.097314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-43045dfd-6daf-4933-b56f-86005b3b0592 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.203837 Aug 19 09:20:59.097897 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 342/648] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:58 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:59.386838 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-71170278-e880-44c6-a556-278b437976de tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:20:59.387714 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-71170278-e880-44c6-a556-278b437976de tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:59.394084 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-71170278-e880-44c6-a556-278b437976de tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:59.394527 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-71170278-e880-44c6-a556-278b437976de tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:59.395991 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-71170278-e880-44c6-a556-278b437976de tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:59.396434 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-71170278-e880-44c6-a556-278b437976de tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:59.543282 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-71170278-e880-44c6-a556-278b437976de tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:20:59.554553 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-71170278-e880-44c6-a556-278b437976de tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1557 microversion: 2.1 time: 0.171591 Aug 19 09:20:59.555584 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 307/649] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:20:59 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:20:59.715628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-96343ef8-0d75-46a2-97f6-2eafa3b43e0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:20:59.716640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-96343ef8-0d75-46a2-97f6-2eafa3b43e0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:20:59.731243 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-96343ef8-0d75-46a2-97f6-2eafa3b43e0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:59.731860 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-96343ef8-0d75-46a2-97f6-2eafa3b43e0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:20:59.732698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-96343ef8-0d75-46a2-97f6-2eafa3b43e0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:20:59.733237 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-96343ef8-0d75-46a2-97f6-2eafa3b43e0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:00.120777 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ee86491a-cd47-4c88-ba74-70fba97f7a28 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:00.121382 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ee86491a-cd47-4c88-ba74-70fba97f7a28 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:00.127106 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee86491a-cd47-4c88-ba74-70fba97f7a28 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:00.127595 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee86491a-cd47-4c88-ba74-70fba97f7a28 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:00.128347 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee86491a-cd47-4c88-ba74-70fba97f7a28 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:00.128775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee86491a-cd47-4c88-ba74-70fba97f7a28 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:00.158199 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-96343ef8-0d75-46a2-97f6-2eafa3b43e0e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.446333 Aug 19 09:21:00.159735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 343/650] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:20:59 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:00.248646 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ee86491a-cd47-4c88-ba74-70fba97f7a28 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:00.256688 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ee86491a-cd47-4c88-ba74-70fba97f7a28 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.139817 Aug 19 09:21:00.257250 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 308/651] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:00 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:00.572439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ba550209-de09-4781-8f22-d0285e819208 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:00.573065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ba550209-de09-4781-8f22-d0285e819208 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:00.579563 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ba550209-de09-4781-8f22-d0285e819208 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:00.580014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ba550209-de09-4781-8f22-d0285e819208 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:00.580783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ba550209-de09-4781-8f22-d0285e819208 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:00.581219 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ba550209-de09-4781-8f22-d0285e819208 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:00.702643 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ba550209-de09-4781-8f22-d0285e819208 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:00.710874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ba550209-de09-4781-8f22-d0285e819208 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1557 microversion: 2.1 time: 0.142488 Aug 19 09:21:00.711469 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 344/652] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:00 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1557 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:01.169842 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-08352125-2c39-49bd-8f2e-edaff3e43a6a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:01.170759 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-08352125-2c39-49bd-8f2e-edaff3e43a6a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:01.177924 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08352125-2c39-49bd-8f2e-edaff3e43a6a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:01.178579 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08352125-2c39-49bd-8f2e-edaff3e43a6a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:01.179685 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08352125-2c39-49bd-8f2e-edaff3e43a6a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:01.180293 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08352125-2c39-49bd-8f2e-edaff3e43a6a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:01.270864 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-08352125-2c39-49bd-8f2e-edaff3e43a6a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.104044 Aug 19 09:21:01.274687 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 309/653] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:01 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:01.274815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-13878305-1b3c-46d6-bd11-4463296acb48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:01.274815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-13878305-1b3c-46d6-bd11-4463296acb48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:01.280383 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13878305-1b3c-46d6-bd11-4463296acb48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:01.280834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13878305-1b3c-46d6-bd11-4463296acb48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:01.281603 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13878305-1b3c-46d6-bd11-4463296acb48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:01.282036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13878305-1b3c-46d6-bd11-4463296acb48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:01.410399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-13878305-1b3c-46d6-bd11-4463296acb48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:01.418002 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-13878305-1b3c-46d6-bd11-4463296acb48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.148440 Aug 19 09:21:01.418559 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 345/654] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:01 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:01.728874 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-df8d3a9e-56e9-4407-aa64-08cddd7846bc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:01.729509 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-df8d3a9e-56e9-4407-aa64-08cddd7846bc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:01.735840 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-df8d3a9e-56e9-4407-aa64-08cddd7846bc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:01.736286 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-df8d3a9e-56e9-4407-aa64-08cddd7846bc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:01.737045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-df8d3a9e-56e9-4407-aa64-08cddd7846bc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:01.737478 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-df8d3a9e-56e9-4407-aa64-08cddd7846bc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:01.861433 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-df8d3a9e-56e9-4407-aa64-08cddd7846bc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:01.869618 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-df8d3a9e-56e9-4407-aa64-08cddd7846bc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1557 microversion: 2.1 time: 0.144812 Aug 19 09:21:01.870181 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 310/655] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:01 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:02.282506 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ec14cbc0-b52e-411b-a650-5ba8657ad98b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:02.283371 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ec14cbc0-b52e-411b-a650-5ba8657ad98b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:02.290131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec14cbc0-b52e-411b-a650-5ba8657ad98b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:02.290578 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec14cbc0-b52e-411b-a650-5ba8657ad98b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:02.291361 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec14cbc0-b52e-411b-a650-5ba8657ad98b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:02.291795 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ec14cbc0-b52e-411b-a650-5ba8657ad98b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:02.409325 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ec14cbc0-b52e-411b-a650-5ba8657ad98b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.130473 Aug 19 09:21:02.410200 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 346/656] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:02 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:21:02.434396 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4e4502fe-0ae9-484f-a6ea-e3ca2344aa70 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:02.435066 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4e4502fe-0ae9-484f-a6ea-e3ca2344aa70 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:02.441006 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4e4502fe-0ae9-484f-a6ea-e3ca2344aa70 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:02.441451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4e4502fe-0ae9-484f-a6ea-e3ca2344aa70 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:02.443185 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4e4502fe-0ae9-484f-a6ea-e3ca2344aa70 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:02.443681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4e4502fe-0ae9-484f-a6ea-e3ca2344aa70 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:02.564851 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4e4502fe-0ae9-484f-a6ea-e3ca2344aa70 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:02.573081 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4e4502fe-0ae9-484f-a6ea-e3ca2344aa70 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.142271 Aug 19 09:21:02.573650 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 311/657] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:02 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:02.888344 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7ae15d3c-3f47-4b52-bc52-94d32b0b3497 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:02.889847 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7ae15d3c-3f47-4b52-bc52-94d32b0b3497 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:02.897552 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ae15d3c-3f47-4b52-bc52-94d32b0b3497 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:02.898448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ae15d3c-3f47-4b52-bc52-94d32b0b3497 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:02.899100 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ae15d3c-3f47-4b52-bc52-94d32b0b3497 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:02.899746 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7ae15d3c-3f47-4b52-bc52-94d32b0b3497 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:03.024220 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7ae15d3c-3f47-4b52-bc52-94d32b0b3497 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:03.032253 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7ae15d3c-3f47-4b52-bc52-94d32b0b3497 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1557 microversion: 2.1 time: 0.148632 Aug 19 09:21:03.032809 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 347/658] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:02 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:03.421289 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b274a082-fa0d-4aea-89da-8ec8d1b686f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:03.422202 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b274a082-fa0d-4aea-89da-8ec8d1b686f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:03.429175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b274a082-fa0d-4aea-89da-8ec8d1b686f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:03.429622 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b274a082-fa0d-4aea-89da-8ec8d1b686f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:03.430390 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b274a082-fa0d-4aea-89da-8ec8d1b686f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:03.430817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b274a082-fa0d-4aea-89da-8ec8d1b686f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:03.590007 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6be9968b-3563-468e-8b3c-70e756ca9931 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:03.590950 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6be9968b-3563-468e-8b3c-70e756ca9931 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:03.592851 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b274a082-fa0d-4aea-89da-8ec8d1b686f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.175148 Aug 19 09:21:03.593494 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 312/659] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:03 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:03.596991 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6be9968b-3563-468e-8b3c-70e756ca9931 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:03.597633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6be9968b-3563-468e-8b3c-70e756ca9931 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:03.598401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6be9968b-3563-468e-8b3c-70e756ca9931 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:03.599088 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6be9968b-3563-468e-8b3c-70e756ca9931 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:03.727227 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6be9968b-3563-468e-8b3c-70e756ca9931 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:03.735558 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6be9968b-3563-468e-8b3c-70e756ca9931 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.149640 Aug 19 09:21:03.736477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 348/660] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:03 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:04.050937 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2dc6cc6b-4a80-4cca-8ec6-a45b35f3c332 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:04.052923 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2dc6cc6b-4a80-4cca-8ec6-a45b35f3c332 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:04.058951 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2dc6cc6b-4a80-4cca-8ec6-a45b35f3c332 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:04.059438 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2dc6cc6b-4a80-4cca-8ec6-a45b35f3c332 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:04.060212 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2dc6cc6b-4a80-4cca-8ec6-a45b35f3c332 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:04.060643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2dc6cc6b-4a80-4cca-8ec6-a45b35f3c332 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:04.198249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2dc6cc6b-4a80-4cca-8ec6-a45b35f3c332 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:04.206707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2dc6cc6b-4a80-4cca-8ec6-a45b35f3c332 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1563 microversion: 2.1 time: 0.160485 Aug 19 09:21:04.207990 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 313/661] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:04 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:04.284743 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-58aa441b-0a07-470f-bf98-c010d78c842f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:04.285246 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-58aa441b-0a07-470f-bf98-c010d78c842f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:04.291761 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58aa441b-0a07-470f-bf98-c010d78c842f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:04.292208 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58aa441b-0a07-470f-bf98-c010d78c842f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:04.293214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58aa441b-0a07-470f-bf98-c010d78c842f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:04.293682 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58aa441b-0a07-470f-bf98-c010d78c842f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:04.389659 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-58aa441b-0a07-470f-bf98-c010d78c842f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lazy-loading 'services' on Instance uuid f4c3bc8f-45ae-4a40-8a3d-d9642d8728df {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:21:04.506375 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-58aa441b-0a07-470f-bf98-c010d78c842f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments/b28d81c0-49ea-40ca-b1b8-049f29372e17" status: 202 len: 0 microversion: 2.1 time: 0.225207 Aug 19 09:21:04.512775 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 349/662] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:21:04 2021] DELETE /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments/b28d81c0-49ea-40ca-b1b8-049f29372e17 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:04.522975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8ce29a96-89ca-4c9c-b410-faf7f75bf8c4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:04.524166 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8ce29a96-89ca-4c9c-b410-faf7f75bf8c4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:04.533686 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ce29a96-89ca-4c9c-b410-faf7f75bf8c4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:04.534194 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ce29a96-89ca-4c9c-b410-faf7f75bf8c4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:04.535000 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ce29a96-89ca-4c9c-b410-faf7f75bf8c4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:04.535453 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ce29a96-89ca-4c9c-b410-faf7f75bf8c4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:04.571970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8ce29a96-89ca-4c9c-b410-faf7f75bf8c4 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053713 Aug 19 09:21:04.573441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 314/663] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:04 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:04.606623 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e4f4cbfa-f46d-4fe8-87bc-1ad1de12a96d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:04.607789 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e4f4cbfa-f46d-4fe8-87bc-1ad1de12a96d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:04.619532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4f4cbfa-f46d-4fe8-87bc-1ad1de12a96d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:04.619532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4f4cbfa-f46d-4fe8-87bc-1ad1de12a96d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:04.619532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4f4cbfa-f46d-4fe8-87bc-1ad1de12a96d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:04.619532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4f4cbfa-f46d-4fe8-87bc-1ad1de12a96d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:04.731652 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e4f4cbfa-f46d-4fe8-87bc-1ad1de12a96d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.129690 Aug 19 09:21:04.732310 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 350/664] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:04 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:21:04.753665 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a276b2d9-a5f8-4c23-a59d-4b9dbf99688a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:04.756547 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a276b2d9-a5f8-4c23-a59d-4b9dbf99688a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:04.763411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a276b2d9-a5f8-4c23-a59d-4b9dbf99688a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:04.764281 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a276b2d9-a5f8-4c23-a59d-4b9dbf99688a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:04.765606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a276b2d9-a5f8-4c23-a59d-4b9dbf99688a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:04.766281 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a276b2d9-a5f8-4c23-a59d-4b9dbf99688a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:05.000869 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a276b2d9-a5f8-4c23-a59d-4b9dbf99688a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:05.010289 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a276b2d9-a5f8-4c23-a59d-4b9dbf99688a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.260382 Aug 19 09:21:05.010908 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 315/665] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:04 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:05.585264 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3e24dd6f-559a-424c-ae9e-ac9092d41dc5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:05.586568 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3e24dd6f-559a-424c-ae9e-ac9092d41dc5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:05.603523 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3e24dd6f-559a-424c-ae9e-ac9092d41dc5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:05.604191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3e24dd6f-559a-424c-ae9e-ac9092d41dc5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:05.604771 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3e24dd6f-559a-424c-ae9e-ac9092d41dc5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:05.605211 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3e24dd6f-559a-424c-ae9e-ac9092d41dc5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:05.640779 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3e24dd6f-559a-424c-ae9e-ac9092d41dc5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059864 Aug 19 09:21:05.644744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 351/666] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:05 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:05.786795 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-aadd4fe2-d823-4ec9-b77d-6b16488e55e0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:05.787750 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-aadd4fe2-d823-4ec9-b77d-6b16488e55e0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:05.795491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aadd4fe2-d823-4ec9-b77d-6b16488e55e0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:05.795936 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aadd4fe2-d823-4ec9-b77d-6b16488e55e0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:05.796708 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aadd4fe2-d823-4ec9-b77d-6b16488e55e0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:05.797141 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aadd4fe2-d823-4ec9-b77d-6b16488e55e0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:05.890826 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-aadd4fe2-d823-4ec9-b77d-6b16488e55e0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.108642 Aug 19 09:21:05.891500 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 316/667] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:05 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:06.028654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6d35c676-3f6c-4ed4-a84a-ea1c4782ccdf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:06.029180 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6d35c676-3f6c-4ed4-a84a-ea1c4782ccdf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:06.041617 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6d35c676-3f6c-4ed4-a84a-ea1c4782ccdf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:06.042154 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6d35c676-3f6c-4ed4-a84a-ea1c4782ccdf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:06.042966 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6d35c676-3f6c-4ed4-a84a-ea1c4782ccdf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:06.043441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6d35c676-3f6c-4ed4-a84a-ea1c4782ccdf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:06.110376 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-61d9225b-94d9-4acf-93fa-a07b8ced2467 req-1524603b-4189-4063-85ae-3ff66c8216ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7db7988b-5e66-43cd-8e4a-d32b1b29786b", "name": "network-vif-plugged", "status": "completed", "tag": "a75a2d3b-a5ee-46a2-88d4-3c5ae8cb26fb"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:06.112422 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:06.112422 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:21:06.122936 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-61d9225b-94d9-4acf-93fa-a07b8ced2467 req-1524603b-4189-4063-85ae-3ff66c8216ee service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:06.123434 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-61d9225b-94d9-4acf-93fa-a07b8ced2467 req-1524603b-4189-4063-85ae-3ff66c8216ee service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:06.136508 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-61d9225b-94d9-4acf-93fa-a07b8ced2467 req-1524603b-4189-4063-85ae-3ff66c8216ee service nova] Creating event network-vif-plugged:a75a2d3b-a5ee-46a2-88d4-3c5ae8cb26fb for instance 7db7988b-5e66-43cd-8e4a-d32b1b29786b on hv-cinder-77387 Aug 19 09:21:06.141905 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-61d9225b-94d9-4acf-93fa-a07b8ced2467 req-1524603b-4189-4063-85ae-3ff66c8216ee service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035912 Aug 19 09:21:06.142492 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 317/668] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:21:06.185346 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6d35c676-3f6c-4ed4-a84a-ea1c4782ccdf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:06.193272 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6d35c676-3f6c-4ed4-a84a-ea1c4782ccdf tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.169674 Aug 19 09:21:06.193838 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 352/669] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:06 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:06.652718 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-888c0ac7-d72e-4f70-810e-98d9f01fa932 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:06.653705 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-888c0ac7-d72e-4f70-810e-98d9f01fa932 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:06.659579 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-888c0ac7-d72e-4f70-810e-98d9f01fa932 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:06.660029 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-888c0ac7-d72e-4f70-810e-98d9f01fa932 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:06.660812 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-888c0ac7-d72e-4f70-810e-98d9f01fa932 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:06.661400 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-888c0ac7-d72e-4f70-810e-98d9f01fa932 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:06.689261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-888c0ac7-d72e-4f70-810e-98d9f01fa932 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040621 Aug 19 09:21:06.689795 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 318/670] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:06 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:21:06.901758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b5fafb7e-7864-4cfe-af25-1873f4704f9e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:06.902661 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b5fafb7e-7864-4cfe-af25-1873f4704f9e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:06.908825 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5fafb7e-7864-4cfe-af25-1873f4704f9e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:06.909209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5fafb7e-7864-4cfe-af25-1873f4704f9e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:06.909963 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5fafb7e-7864-4cfe-af25-1873f4704f9e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:06.910394 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5fafb7e-7864-4cfe-af25-1873f4704f9e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:07.003775 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b5fafb7e-7864-4cfe-af25-1873f4704f9e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.105502 Aug 19 09:21:07.004457 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 353/671] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:06 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:07.161277 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1452967429", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "networks": [{"uuid": "2cdad480-ecf1-480c-be1b-4e9459f44f51"}]}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:07.210720 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9e8d5a8f-55a3-4025-8914-c5c3825a87a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:07.211475 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9e8d5a8f-55a3-4025-8914-c5c3825a87a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:07.215159 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] validate_networks() for [('2cdad480-ecf1-480c-be1b-4e9459f44f51', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:21:07.217927 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e8d5a8f-55a3-4025-8914-c5c3825a87a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:07.218372 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e8d5a8f-55a3-4025-8914-c5c3825a87a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:07.219136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e8d5a8f-55a3-4025-8914-c5c3825a87a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:07.219604 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e8d5a8f-55a3-4025-8914-c5c3825a87a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:07.343250 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9e8d5a8f-55a3-4025-8914-c5c3825a87a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:07.351778 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9e8d5a8f-55a3-4025-8914-c5c3825a87a7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1318 microversion: 2.1 time: 0.145562 Aug 19 09:21:07.352356 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 354/672] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:07 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:07.564478 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:21:07.564902 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:21:07.565403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:21:07.565839 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:21:07.566248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:21:07.575106 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:07.575576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:07.576372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:07.576803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:07.592651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Getting quotas for project ed982dbeb62c47f9b68eed4195a3e3a7. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:21:07.596481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Getting quotas for user c1ac96455c3e469d94469fcaf530290a and project ed982dbeb62c47f9b68eed4195a3e3a7. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:21:07.607684 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:21:07.609941 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:21:07.654415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-73edf135-e12b-440e-beec-c8b8e5d75947 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497847 Aug 19 09:21:07.655055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 319/673] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:21:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:21:07.665199 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e583034e-cbff-402f-a14e-2dda7deb048c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:07.665807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e583034e-cbff-402f-a14e-2dda7deb048c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:07.717501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e583034e-cbff-402f-a14e-2dda7deb048c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:07.724860 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e583034e-cbff-402f-a14e-2dda7deb048c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1219 microversion: 2.1 time: 0.063212 Aug 19 09:21:07.725490 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 355/674] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:07 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:08.015626 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6c7b141f-53c8-4010-8c2e-6a991cdf0ffd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:08.016131 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6c7b141f-53c8-4010-8c2e-6a991cdf0ffd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:08.022764 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6c7b141f-53c8-4010-8c2e-6a991cdf0ffd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:08.023222 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6c7b141f-53c8-4010-8c2e-6a991cdf0ffd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:08.024139 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6c7b141f-53c8-4010-8c2e-6a991cdf0ffd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:08.024735 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6c7b141f-53c8-4010-8c2e-6a991cdf0ffd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:08.183854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6c7b141f-53c8-4010-8c2e-6a991cdf0ffd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.172344 Aug 19 09:21:08.185562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 320/675] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:08 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:08.369092 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-00eca318-765f-4179-a840-275353be0809 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:08.369701 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-00eca318-765f-4179-a840-275353be0809 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:08.375912 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00eca318-765f-4179-a840-275353be0809 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:08.376359 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00eca318-765f-4179-a840-275353be0809 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:08.377120 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00eca318-765f-4179-a840-275353be0809 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:08.377557 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00eca318-765f-4179-a840-275353be0809 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:08.500855 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-00eca318-765f-4179-a840-275353be0809 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:08.508334 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-00eca318-765f-4179-a840-275353be0809 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1508 microversion: 2.1 time: 0.143634 Aug 19 09:21:08.508886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 356/676] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:08 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:08.742600 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bb5ad0fa-39a0-405d-98e0-d3c2a28c3237 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:08.743315 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bb5ad0fa-39a0-405d-98e0-d3c2a28c3237 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:08.750896 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bb5ad0fa-39a0-405d-98e0-d3c2a28c3237 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:08.751554 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bb5ad0fa-39a0-405d-98e0-d3c2a28c3237 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:08.752782 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bb5ad0fa-39a0-405d-98e0-d3c2a28c3237 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:08.753227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bb5ad0fa-39a0-405d-98e0-d3c2a28c3237 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:08.824689 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bb5ad0fa-39a0-405d-98e0-d3c2a28c3237 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:08.834248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bb5ad0fa-39a0-405d-98e0-d3c2a28c3237 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1279 microversion: 2.1 time: 0.095409 Aug 19 09:21:08.835226 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 321/677] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:08 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1279 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:09.009751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f9c5f60b-ecad-4f3b-b035-aa17f5e62ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:09.010437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f9c5f60b-ecad-4f3b-b035-aa17f5e62ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:09.016486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9c5f60b-ecad-4f3b-b035-aa17f5e62ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:09.016971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9c5f60b-ecad-4f3b-b035-aa17f5e62ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:09.017753 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9c5f60b-ecad-4f3b-b035-aa17f5e62ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:09.018187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9c5f60b-ecad-4f3b-b035-aa17f5e62ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:09.045398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f9c5f60b-ecad-4f3b-b035-aa17f5e62ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Going to try to terminate instance {{(pid=107957) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:21:09.138624 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f9c5f60b-ecad-4f3b-b035-aa17f5e62ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 204 len: 0 microversion: 2.1 time: 0.133803 Aug 19 09:21:09.139314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 357/678] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:21:09 2021] DELETE /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:21:09.147693 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-fdcc4b21-6bdf-4ad7-b527-86a644376a6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:09.148312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-fdcc4b21-6bdf-4ad7-b527-86a644376a6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:09.153924 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fdcc4b21-6bdf-4ad7-b527-86a644376a6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:09.154373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fdcc4b21-6bdf-4ad7-b527-86a644376a6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:09.155142 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fdcc4b21-6bdf-4ad7-b527-86a644376a6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:09.155615 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fdcc4b21-6bdf-4ad7-b527-86a644376a6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:09.196931 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4aeab887-054e-4517-b252-655533accc9c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:09.198100 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4aeab887-054e-4517-b252-655533accc9c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:09.204218 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4aeab887-054e-4517-b252-655533accc9c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:09.204745 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4aeab887-054e-4517-b252-655533accc9c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:09.205520 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4aeab887-054e-4517-b252-655533accc9c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:09.205978 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4aeab887-054e-4517-b252-655533accc9c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:09.320235 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4aeab887-054e-4517-b252-655533accc9c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.128031 Aug 19 09:21:09.324163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 358/679] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:09 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:21:09.328744 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-fdcc4b21-6bdf-4ad7-b527-86a644376a6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:09.336954 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-fdcc4b21-6bdf-4ad7-b527-86a644376a6a tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1509 microversion: 2.1 time: 0.193642 Aug 19 09:21:09.337518 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 322/680] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:09 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:09.859427 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-048bda0a-8226-4181-bd26-74c27ab71b7c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "780d3426-8a0f-4b74-b797-3eb77ae0f431"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:09.860507 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-048bda0a-8226-4181-bd26-74c27ab71b7c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:09.862102 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a4d4bca5-917e-42ea-a704-d0104a02a97c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:09.863513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a4d4bca5-917e-42ea-a704-d0104a02a97c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:09.867990 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-048bda0a-8226-4181-bd26-74c27ab71b7c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:09.868514 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-048bda0a-8226-4181-bd26-74c27ab71b7c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:09.869353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-048bda0a-8226-4181-bd26-74c27ab71b7c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:09.869846 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-048bda0a-8226-4181-bd26-74c27ab71b7c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:09.872969 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4d4bca5-917e-42ea-a704-d0104a02a97c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:09.873630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4d4bca5-917e-42ea-a704-d0104a02a97c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:09.874593 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4d4bca5-917e-42ea-a704-d0104a02a97c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:09.875228 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4d4bca5-917e-42ea-a704-d0104a02a97c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:10.063201 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a4d4bca5-917e-42ea-a704-d0104a02a97c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:10.071409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a4d4bca5-917e-42ea-a704-d0104a02a97c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.219171 Aug 19 09:21:10.072532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 359/681] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:09 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:10.191456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-048bda0a-8226-4181-bd26-74c27ab71b7c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "POST /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337747 Aug 19 09:21:10.192499 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 323/682] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:21:09 2021] POST /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:10.265839 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-1ab3aa88-1a17-4930-af3f-b9be3d02c3bd req-e44ee38f-73c2-421c-bd6e-54b213761a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db6043f-4b5d-4736-9623-cc4a3220ba35", "tag": "a57e9f7c-c1f7-45a1-a64e-e8297bcf8c36"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:10.267729 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:10.267729 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:21:10.277980 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-1ab3aa88-1a17-4930-af3f-b9be3d02c3bd req-e44ee38f-73c2-421c-bd6e-54b213761a2a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:10.278574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-1ab3aa88-1a17-4930-af3f-b9be3d02c3bd req-e44ee38f-73c2-421c-bd6e-54b213761a2a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:10.293614 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-1ab3aa88-1a17-4930-af3f-b9be3d02c3bd req-e44ee38f-73c2-421c-bd6e-54b213761a2a service nova] Creating event network-changed:a57e9f7c-c1f7-45a1-a64e-e8297bcf8c36 for instance 2db6043f-4b5d-4736-9623-cc4a3220ba35 on hv-cinder-77387 Aug 19 09:21:10.309039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-1ab3aa88-1a17-4930-af3f-b9be3d02c3bd req-e44ee38f-73c2-421c-bd6e-54b213761a2a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036728 Aug 19 09:21:10.312658 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 360/683] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:10.332307 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-98440bc2-bc85-41c8-91e0-06f471b1a989 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:10.333735 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-98440bc2-bc85-41c8-91e0-06f471b1a989 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:10.339820 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-98440bc2-bc85-41c8-91e0-06f471b1a989 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:10.340274 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-98440bc2-bc85-41c8-91e0-06f471b1a989 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:10.341035 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-98440bc2-bc85-41c8-91e0-06f471b1a989 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:10.341569 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-98440bc2-bc85-41c8-91e0-06f471b1a989 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:10.360449 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fc4885f8-e8ec-457f-9ad9-45421a3d89f7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:10.361483 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fc4885f8-e8ec-457f-9ad9-45421a3d89f7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:10.370578 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fc4885f8-e8ec-457f-9ad9-45421a3d89f7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:10.371503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fc4885f8-e8ec-457f-9ad9-45421a3d89f7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:10.372436 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fc4885f8-e8ec-457f-9ad9-45421a3d89f7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:10.373028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fc4885f8-e8ec-457f-9ad9-45421a3d89f7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:10.468411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-98440bc2-bc85-41c8-91e0-06f471b1a989 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.140106 Aug 19 09:21:10.469051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 324/684] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:10 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:10.529501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fc4885f8-e8ec-457f-9ad9-45421a3d89f7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:10.539177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fc4885f8-e8ec-457f-9ad9-45421a3d89f7 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1509 microversion: 2.1 time: 0.188897 Aug 19 09:21:10.539907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 361/685] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:10 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:11.090517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b8869fdb-c07d-499c-9550-35bf1e1945eb tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:11.091513 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b8869fdb-c07d-499c-9550-35bf1e1945eb tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:11.107880 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b8869fdb-c07d-499c-9550-35bf1e1945eb tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:11.108332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b8869fdb-c07d-499c-9550-35bf1e1945eb tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:11.109120 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b8869fdb-c07d-499c-9550-35bf1e1945eb tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:11.109554 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b8869fdb-c07d-499c-9550-35bf1e1945eb tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:11.345903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b8869fdb-c07d-499c-9550-35bf1e1945eb tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:11.354045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b8869fdb-c07d-499c-9550-35bf1e1945eb tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.268322 Aug 19 09:21:11.354606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 325/686] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:11 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:11.480418 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-66580159-c5ca-4b1c-ac09-279ec19921a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:11.481385 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-66580159-c5ca-4b1c-ac09-279ec19921a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:11.487534 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66580159-c5ca-4b1c-ac09-279ec19921a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:11.487982 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66580159-c5ca-4b1c-ac09-279ec19921a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:11.488744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66580159-c5ca-4b1c-ac09-279ec19921a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:11.489177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-66580159-c5ca-4b1c-ac09-279ec19921a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:11.556466 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e9a0e878-e0ab-4acf-b9dd-f1bf1f96d319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:11.557077 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e9a0e878-e0ab-4acf-b9dd-f1bf1f96d319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:11.562758 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e9a0e878-e0ab-4acf-b9dd-f1bf1f96d319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:11.563197 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e9a0e878-e0ab-4acf-b9dd-f1bf1f96d319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:11.563988 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e9a0e878-e0ab-4acf-b9dd-f1bf1f96d319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:11.564412 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e9a0e878-e0ab-4acf-b9dd-f1bf1f96d319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:11.640493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-66580159-c5ca-4b1c-ac09-279ec19921a7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.163607 Aug 19 09:21:11.644673 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 362/687] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:11 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:11.682794 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e9a0e878-e0ab-4acf-b9dd-f1bf1f96d319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:11.689917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e9a0e878-e0ab-4acf-b9dd-f1bf1f96d319 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1509 microversion: 2.1 time: 0.137633 Aug 19 09:21:11.690480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 326/688] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:11 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1509 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:12.370885 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-81f3d7fa-2c9e-499d-a25b-5f2e05e17ada tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:12.371765 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-81f3d7fa-2c9e-499d-a25b-5f2e05e17ada tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:12.385643 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-81f3d7fa-2c9e-499d-a25b-5f2e05e17ada tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:12.386115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-81f3d7fa-2c9e-499d-a25b-5f2e05e17ada tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:12.387145 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-81f3d7fa-2c9e-499d-a25b-5f2e05e17ada tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:12.387309 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-81f3d7fa-2c9e-499d-a25b-5f2e05e17ada tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:12.509602 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-81f3d7fa-2c9e-499d-a25b-5f2e05e17ada tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:12.516732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-81f3d7fa-2c9e-499d-a25b-5f2e05e17ada tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.150303 Aug 19 09:21:12.517277 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 363/689] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:12 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:12.652097 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d5b9e88c-4190-49a8-98ee-cf18ce7a5706 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:12.653111 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d5b9e88c-4190-49a8-98ee-cf18ce7a5706 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:12.659549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5b9e88c-4190-49a8-98ee-cf18ce7a5706 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:12.659989 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5b9e88c-4190-49a8-98ee-cf18ce7a5706 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:12.660729 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5b9e88c-4190-49a8-98ee-cf18ce7a5706 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:12.661151 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5b9e88c-4190-49a8-98ee-cf18ce7a5706 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:12.705441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1cb9bf46-39fb-4679-b312-6d60fba323e2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:12.706047 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1cb9bf46-39fb-4679-b312-6d60fba323e2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:12.711787 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cb9bf46-39fb-4679-b312-6d60fba323e2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:12.712232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cb9bf46-39fb-4679-b312-6d60fba323e2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:12.713081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cb9bf46-39fb-4679-b312-6d60fba323e2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:12.713516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cb9bf46-39fb-4679-b312-6d60fba323e2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:12.837028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1cb9bf46-39fb-4679-b312-6d60fba323e2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:12.844354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1cb9bf46-39fb-4679-b312-6d60fba323e2 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1509 microversion: 2.1 time: 0.142440 Aug 19 09:21:12.845247 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 364/690] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:12 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1509 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:12.846754 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d5b9e88c-4190-49a8-98ee-cf18ce7a5706 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.198173 Aug 19 09:21:12.848235 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 327/691] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:12 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:21:13.254399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-1ac87cc2-968c-47ba-8eaf-4e057ff8e8b9 req-16d0e1ec-8416-49dd-abd9-ac03c53e418e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf", "name": "network-vif-deleted", "tag": "0012aba4-1975-4e17-9e36-63ccd5b799da"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:13.257094 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:13.257094 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:21:13.263791 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-1ac87cc2-968c-47ba-8eaf-4e057ff8e8b9 req-16d0e1ec-8416-49dd-abd9-ac03c53e418e service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:13.264236 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-1ac87cc2-968c-47ba-8eaf-4e057ff8e8b9 req-16d0e1ec-8416-49dd-abd9-ac03c53e418e service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:13.275018 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-1ac87cc2-968c-47ba-8eaf-4e057ff8e8b9 req-16d0e1ec-8416-49dd-abd9-ac03c53e418e service nova] Creating event network-vif-deleted:0012aba4-1975-4e17-9e36-63ccd5b799da for instance ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf on hv-cinder-77387 Aug 19 09:21:13.279623 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-1ac87cc2-968c-47ba-8eaf-4e057ff8e8b9 req-16d0e1ec-8416-49dd-abd9-ac03c53e418e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028749 Aug 19 09:21:13.280181 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 365/692] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:21:13.533503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a19e002f-e907-4280-ac77-3ad376b76d04 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:13.534238 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a19e002f-e907-4280-ac77-3ad376b76d04 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:13.541445 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a19e002f-e907-4280-ac77-3ad376b76d04 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:13.541894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a19e002f-e907-4280-ac77-3ad376b76d04 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:13.542652 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a19e002f-e907-4280-ac77-3ad376b76d04 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:13.543086 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a19e002f-e907-4280-ac77-3ad376b76d04 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:13.843001 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a19e002f-e907-4280-ac77-3ad376b76d04 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:13.850480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a19e002f-e907-4280-ac77-3ad376b76d04 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.320971 Aug 19 09:21:13.851025 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 328/693] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:13 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:13.859811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-193d7d78-6c49-4ff9-9e59-6566cdd1fdc9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:13.860787 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-193d7d78-6c49-4ff9-9e59-6566cdd1fdc9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:13.861154 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c52a28c7-d2a2-48d0-8428-d2f047cec522 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:13.861763 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c52a28c7-d2a2-48d0-8428-d2f047cec522 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:13.866972 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-193d7d78-6c49-4ff9-9e59-6566cdd1fdc9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:13.867444 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-193d7d78-6c49-4ff9-9e59-6566cdd1fdc9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:13.867559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c52a28c7-d2a2-48d0-8428-d2f047cec522 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:13.867977 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c52a28c7-d2a2-48d0-8428-d2f047cec522 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:13.868226 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-193d7d78-6c49-4ff9-9e59-6566cdd1fdc9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:13.868650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-193d7d78-6c49-4ff9-9e59-6566cdd1fdc9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:13.868785 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c52a28c7-d2a2-48d0-8428-d2f047cec522 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:13.869160 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c52a28c7-d2a2-48d0-8428-d2f047cec522 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:13.928051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c52a28c7-d2a2-48d0-8428-d2f047cec522 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:13.935007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c52a28c7-d2a2-48d0-8428-d2f047cec522 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1467 microversion: 2.1 time: 0.077320 Aug 19 09:21:13.935592 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 329/694] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:13 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1467 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:14.867866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7688dca0-a74d-4993-8db9-31135042d14c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:14.868507 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7688dca0-a74d-4993-8db9-31135042d14c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:14.874601 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7688dca0-a74d-4993-8db9-31135042d14c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:14.875039 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7688dca0-a74d-4993-8db9-31135042d14c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:14.875832 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7688dca0-a74d-4993-8db9-31135042d14c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:14.876259 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7688dca0-a74d-4993-8db9-31135042d14c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:14.996699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7688dca0-a74d-4993-8db9-31135042d14c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:15.003881 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7688dca0-a74d-4993-8db9-31135042d14c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.140438 Aug 19 09:21:15.004432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 330/695] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:14 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:15.009254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0a44f775-4ecd-489e-8781-08c74c825dfc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:15.009849 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0a44f775-4ecd-489e-8781-08c74c825dfc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:15.015030 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a44f775-4ecd-489e-8781-08c74c825dfc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:15.015526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a44f775-4ecd-489e-8781-08c74c825dfc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:15.016347 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a44f775-4ecd-489e-8781-08c74c825dfc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:15.016781 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a44f775-4ecd-489e-8781-08c74c825dfc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:15.079252 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0a44f775-4ecd-489e-8781-08c74c825dfc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:15.086508 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0a44f775-4ecd-489e-8781-08c74c825dfc tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1467 microversion: 2.1 time: 0.081155 Aug 19 09:21:15.087064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 331/696] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:15 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1467 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:16.020742 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7c479fb0-d671-497c-91ee-f5dfa4e7dce4 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:16.021539 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7c479fb0-d671-497c-91ee-f5dfa4e7dce4 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:16.028798 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c479fb0-d671-497c-91ee-f5dfa4e7dce4 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:16.029245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c479fb0-d671-497c-91ee-f5dfa4e7dce4 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:16.030008 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c479fb0-d671-497c-91ee-f5dfa4e7dce4 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:16.030442 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c479fb0-d671-497c-91ee-f5dfa4e7dce4 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:16.147580 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7c479fb0-d671-497c-91ee-f5dfa4e7dce4 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:16.154585 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7c479fb0-d671-497c-91ee-f5dfa4e7dce4 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.137514 Aug 19 09:21:16.155141 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 332/697] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:16 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:16.159220 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7e541282-f403-4a70-83fa-485dee2d556f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:16.159839 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7e541282-f403-4a70-83fa-485dee2d556f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:16.165120 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7e541282-f403-4a70-83fa-485dee2d556f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:16.165562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7e541282-f403-4a70-83fa-485dee2d556f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:16.166321 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7e541282-f403-4a70-83fa-485dee2d556f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:16.166756 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7e541282-f403-4a70-83fa-485dee2d556f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:16.227296 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7e541282-f403-4a70-83fa-485dee2d556f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:16.234423 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7e541282-f403-4a70-83fa-485dee2d556f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1467 microversion: 2.1 time: 0.078335 Aug 19 09:21:16.235009 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 333/698] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:16 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1467 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:16.748620 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-193d7d78-6c49-4ff9-9e59-6566cdd1fdc9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 2.893099 Aug 19 09:21:16.749500 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 366/699] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:13 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 2895 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:17.172288 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0a73e03e-308b-4c6a-b909-6b3e0f908683 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:17.172922 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0a73e03e-308b-4c6a-b909-6b3e0f908683 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:17.181682 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a73e03e-308b-4c6a-b909-6b3e0f908683 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:17.182242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a73e03e-308b-4c6a-b909-6b3e0f908683 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:17.183132 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a73e03e-308b-4c6a-b909-6b3e0f908683 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:17.183603 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a73e03e-308b-4c6a-b909-6b3e0f908683 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:17.251800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:17.252498 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:17.262190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:17.262651 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:17.263477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:17.263948 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:17.297984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:17.298432 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:17.298889 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lazy-loading 'fault' on Instance uuid ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:21:17.321306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0a73e03e-308b-4c6a-b909-6b3e0f908683 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:17.328503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0a73e03e-308b-4c6a-b909-6b3e0f908683 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.160086 Aug 19 09:21:17.329070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 334/700] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:17 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:17.340967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:17.348111 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c1718563-5405-4076-9ef6-a5004df578d5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 200 len: 1312 microversion: 2.1 time: 0.100446 Aug 19 09:21:17.348927 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 367/701] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:17 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:17.759864 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3a2278dc-5e71-4911-a544-f7f8c4f4f2bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:17.760769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3a2278dc-5e71-4911-a544-f7f8c4f4f2bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:17.766436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3a2278dc-5e71-4911-a544-f7f8c4f4f2bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:17.766888 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3a2278dc-5e71-4911-a544-f7f8c4f4f2bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:17.767679 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3a2278dc-5e71-4911-a544-f7f8c4f4f2bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:17.768104 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3a2278dc-5e71-4911-a544-f7f8c4f4f2bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:17.889105 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3a2278dc-5e71-4911-a544-f7f8c4f4f2bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.132696 Aug 19 09:21:17.889921 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 335/702] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:17 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:18.345426 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e44a63d4-a994-4d02-b432-0b132aa1dc3a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:18.346061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e44a63d4-a994-4d02-b432-0b132aa1dc3a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:18.353655 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e44a63d4-a994-4d02-b432-0b132aa1dc3a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:18.354102 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e44a63d4-a994-4d02-b432-0b132aa1dc3a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:18.354879 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e44a63d4-a994-4d02-b432-0b132aa1dc3a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:18.355336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e44a63d4-a994-4d02-b432-0b132aa1dc3a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:18.366630 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-03601e31-fc86-4426-b577-f9fccf1c2e87 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:18.367221 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-03601e31-fc86-4426-b577-f9fccf1c2e87 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:18.373549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-03601e31-fc86-4426-b577-f9fccf1c2e87 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:18.373994 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-03601e31-fc86-4426-b577-f9fccf1c2e87 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:18.374771 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-03601e31-fc86-4426-b577-f9fccf1c2e87 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:18.375200 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-03601e31-fc86-4426-b577-f9fccf1c2e87 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:18.388985 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-03601e31-fc86-4426-b577-f9fccf1c2e87 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] HTTP exception thrown: Instance ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf could not be found. Aug 19 09:21:18.389575 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-03601e31-fc86-4426-b577-f9fccf1c2e87 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Returning 404 to user: Instance ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:21:18.390421 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-03601e31-fc86-4426-b577-f9fccf1c2e87 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf" status: 404 len: 111 microversion: 2.1 time: 0.028668 Aug 19 09:21:18.390962 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 336/703] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:18 2021] GET /compute/v2.1/servers/ef9e24fe-c874-4f41-9c0b-6cbb4cf2b7bf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 09:21:18.399247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ef95240f-343c-4c1a-b2a6-43c29c183135 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:18.399756 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ef95240f-343c-4c1a-b2a6-43c29c183135 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:18.405346 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef95240f-343c-4c1a-b2a6-43c29c183135 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:18.405786 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef95240f-343c-4c1a-b2a6-43c29c183135 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:18.406540 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef95240f-343c-4c1a-b2a6-43c29c183135 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:18.406968 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef95240f-343c-4c1a-b2a6-43c29c183135 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:18.431792 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ef95240f-343c-4c1a-b2a6-43c29c183135 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:21:18.479485 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e44a63d4-a994-4d02-b432-0b132aa1dc3a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:18.486771 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e44a63d4-a994-4d02-b432-0b132aa1dc3a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.145059 Aug 19 09:21:18.487347 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 368/704] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:18 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:18.509847 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ef95240f-343c-4c1a-b2a6-43c29c183135 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 204 len: 0 microversion: 2.1 time: 0.114443 Aug 19 09:21:18.510529 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 337/705] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:21:18 2021] DELETE /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 09:21:18.518848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d96f6af6-2d13-4d86-bb1a-792ad045da69 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:18.519938 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d96f6af6-2d13-4d86-bb1a-792ad045da69 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:18.528240 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d96f6af6-2d13-4d86-bb1a-792ad045da69 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:18.528720 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d96f6af6-2d13-4d86-bb1a-792ad045da69 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:18.529489 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d96f6af6-2d13-4d86-bb1a-792ad045da69 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:18.529910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d96f6af6-2d13-4d86-bb1a-792ad045da69 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:18.654657 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d96f6af6-2d13-4d86-bb1a-792ad045da69 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:18.663613 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d96f6af6-2d13-4d86-bb1a-792ad045da69 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.147173 Aug 19 09:21:18.663613 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 369/706] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:18 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:18.901790 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d160fef6-1800-4260-ac3d-781f981c0428 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:18.902792 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d160fef6-1800-4260-ac3d-781f981c0428 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:18.908567 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d160fef6-1800-4260-ac3d-781f981c0428 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:18.909009 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d160fef6-1800-4260-ac3d-781f981c0428 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:18.909765 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d160fef6-1800-4260-ac3d-781f981c0428 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:18.910194 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d160fef6-1800-4260-ac3d-781f981c0428 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:19.503950 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c84fe31f-49ea-47a2-bbfe-ff7d039e87e3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:19.504554 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c84fe31f-49ea-47a2-bbfe-ff7d039e87e3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:19.510474 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c84fe31f-49ea-47a2-bbfe-ff7d039e87e3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:19.510918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c84fe31f-49ea-47a2-bbfe-ff7d039e87e3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:19.511713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c84fe31f-49ea-47a2-bbfe-ff7d039e87e3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:19.512142 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c84fe31f-49ea-47a2-bbfe-ff7d039e87e3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:19.628415 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c84fe31f-49ea-47a2-bbfe-ff7d039e87e3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:19.636168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c84fe31f-49ea-47a2-bbfe-ff7d039e87e3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.135873 Aug 19 09:21:19.636723 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 370/707] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:19 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:19.679140 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4b9f21fa-3592-4910-bd6b-c76810183d83 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:19.679881 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4b9f21fa-3592-4910-bd6b-c76810183d83 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:19.685711 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b9f21fa-3592-4910-bd6b-c76810183d83 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:19.686157 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b9f21fa-3592-4910-bd6b-c76810183d83 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:19.686924 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b9f21fa-3592-4910-bd6b-c76810183d83 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:19.687382 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4b9f21fa-3592-4910-bd6b-c76810183d83 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:19.806546 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4b9f21fa-3592-4910-bd6b-c76810183d83 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:19.813871 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4b9f21fa-3592-4910-bd6b-c76810183d83 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.138374 Aug 19 09:21:19.814424 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 371/708] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:19 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:20.652852 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-25f04128-7b3e-4e63-a57f-fb54c3d8fa4c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:20.653445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-25f04128-7b3e-4e63-a57f-fb54c3d8fa4c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:20.659572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-25f04128-7b3e-4e63-a57f-fb54c3d8fa4c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:20.660013 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-25f04128-7b3e-4e63-a57f-fb54c3d8fa4c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:20.660760 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-25f04128-7b3e-4e63-a57f-fb54c3d8fa4c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:20.661184 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-25f04128-7b3e-4e63-a57f-fb54c3d8fa4c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:20.783478 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-25f04128-7b3e-4e63-a57f-fb54c3d8fa4c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:20.791099 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-25f04128-7b3e-4e63-a57f-fb54c3d8fa4c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.141922 Aug 19 09:21:20.791672 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 372/709] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:20 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:20.830468 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-907fb784-9596-472a-9f05-d68f7cd64769 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:20.831065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-907fb784-9596-472a-9f05-d68f7cd64769 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:20.837313 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-907fb784-9596-472a-9f05-d68f7cd64769 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:20.837760 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-907fb784-9596-472a-9f05-d68f7cd64769 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:20.838507 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-907fb784-9596-472a-9f05-d68f7cd64769 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:20.838934 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-907fb784-9596-472a-9f05-d68f7cd64769 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:20.954906 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-907fb784-9596-472a-9f05-d68f7cd64769 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:20.962774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-907fb784-9596-472a-9f05-d68f7cd64769 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.135778 Aug 19 09:21:20.963361 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 373/710] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:20 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:21.808633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8a6e0f57-9dfa-4ff5-972d-f90d2b674d5b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:21.809240 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8a6e0f57-9dfa-4ff5-972d-f90d2b674d5b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:21.814980 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8a6e0f57-9dfa-4ff5-972d-f90d2b674d5b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:21.815461 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8a6e0f57-9dfa-4ff5-972d-f90d2b674d5b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:21.816216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8a6e0f57-9dfa-4ff5-972d-f90d2b674d5b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:21.816644 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8a6e0f57-9dfa-4ff5-972d-f90d2b674d5b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:21.934596 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8a6e0f57-9dfa-4ff5-972d-f90d2b674d5b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:21.941615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8a6e0f57-9dfa-4ff5-972d-f90d2b674d5b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.136621 Aug 19 09:21:21.942178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 374/711] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:21 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:21.979017 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-dbbfa8d4-10e9-40cf-899b-67cd9633c34f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:21.979635 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-dbbfa8d4-10e9-40cf-899b-67cd9633c34f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:21.985062 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbbfa8d4-10e9-40cf-899b-67cd9633c34f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:21.985553 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbbfa8d4-10e9-40cf-899b-67cd9633c34f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:21.986298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbbfa8d4-10e9-40cf-899b-67cd9633c34f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:21.986729 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbbfa8d4-10e9-40cf-899b-67cd9633c34f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:22.106733 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dbbfa8d4-10e9-40cf-899b-67cd9633c34f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:22.113741 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-dbbfa8d4-10e9-40cf-899b-67cd9633c34f tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.137944 Aug 19 09:21:22.114295 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 375/712] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:21 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:22.763419 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d160fef6-1800-4260-ac3d-781f981c0428 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 3.865483 Aug 19 09:21:22.764275 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 338/713] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:18 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 3868 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:22.957618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7210f4b5-4d7c-470c-9023-5393a31649ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:22.958514 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7210f4b5-4d7c-470c-9023-5393a31649ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:22.964338 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7210f4b5-4d7c-470c-9023-5393a31649ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:22.964850 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7210f4b5-4d7c-470c-9023-5393a31649ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:22.965736 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7210f4b5-4d7c-470c-9023-5393a31649ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:22.966312 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7210f4b5-4d7c-470c-9023-5393a31649ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:23.089364 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7210f4b5-4d7c-470c-9023-5393a31649ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:23.096649 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7210f4b5-4d7c-470c-9023-5393a31649ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.142653 Aug 19 09:21:23.097389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 376/714] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:22 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:23.097591 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2db51d0b-fc4c-47d8-983c-76361da645ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:23.098348 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2db51d0b-fc4c-47d8-983c-76361da645ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:23.105480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2db51d0b-fc4c-47d8-983c-76361da645ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:23.106253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2db51d0b-fc4c-47d8-983c-76361da645ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:23.107047 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2db51d0b-fc4c-47d8-983c-76361da645ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:23.107790 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2db51d0b-fc4c-47d8-983c-76361da645ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:23.131348 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-963bc3d0-5d20-4233-9c9d-ce2adba2d0a6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:23.131959 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-963bc3d0-5d20-4233-9c9d-ce2adba2d0a6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:23.137737 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-963bc3d0-5d20-4233-9c9d-ce2adba2d0a6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:23.138190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-963bc3d0-5d20-4233-9c9d-ce2adba2d0a6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:23.138962 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-963bc3d0-5d20-4233-9c9d-ce2adba2d0a6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:23.139428 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-963bc3d0-5d20-4233-9c9d-ce2adba2d0a6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:23.191833 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-2db51d0b-fc4c-47d8-983c-76361da645ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lazy-loading 'services' on Instance uuid 7db7988b-5e66-43cd-8e4a-d32b1b29786b {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:21:23.258177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2db51d0b-fc4c-47d8-983c-76361da645ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments/780d3426-8a0f-4b74-b797-3eb77ae0f431" status: 202 len: 0 microversion: 2.1 time: 0.164666 Aug 19 09:21:23.258884 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 339/715] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:21:23 2021] DELETE /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments/780d3426-8a0f-4b74-b797-3eb77ae0f431 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:21:23.264163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-963bc3d0-5d20-4233-9c9d-ce2adba2d0a6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:23.267774 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7f29a06d-e0a6-46d9-ad4a-93053d116de3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:23.268911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7f29a06d-e0a6-46d9-ad4a-93053d116de3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:23.272460 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-963bc3d0-5d20-4233-9c9d-ce2adba2d0a6 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.144871 Aug 19 09:21:23.276107 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f29a06d-e0a6-46d9-ad4a-93053d116de3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:23.276625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f29a06d-e0a6-46d9-ad4a-93053d116de3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:23.277397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f29a06d-e0a6-46d9-ad4a-93053d116de3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:23.277824 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f29a06d-e0a6-46d9-ad4a-93053d116de3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:23.282306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 377/716] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:23 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:23.306986 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7f29a06d-e0a6-46d9-ad4a-93053d116de3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043547 Aug 19 09:21:23.307566 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 340/717] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:23 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:21:23.773896 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-38aa015e-5b85-4f3a-899c-8aff5f41df09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:23.774797 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-38aa015e-5b85-4f3a-899c-8aff5f41df09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:23.780628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38aa015e-5b85-4f3a-899c-8aff5f41df09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:23.781068 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38aa015e-5b85-4f3a-899c-8aff5f41df09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:23.781812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38aa015e-5b85-4f3a-899c-8aff5f41df09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:23.782237 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38aa015e-5b85-4f3a-899c-8aff5f41df09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:23.895850 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-38aa015e-5b85-4f3a-899c-8aff5f41df09 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.125352 Aug 19 09:21:23.897110 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 378/718] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:23 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:24.113514 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2dfa6397-287d-401e-b09c-d089ec76fc14 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:24.114121 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2dfa6397-287d-401e-b09c-d089ec76fc14 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:24.120930 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2dfa6397-287d-401e-b09c-d089ec76fc14 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:24.121368 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2dfa6397-287d-401e-b09c-d089ec76fc14 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:24.122128 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2dfa6397-287d-401e-b09c-d089ec76fc14 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:24.122552 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2dfa6397-287d-401e-b09c-d089ec76fc14 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:24.242478 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2dfa6397-287d-401e-b09c-d089ec76fc14 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:24.249588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2dfa6397-287d-401e-b09c-d089ec76fc14 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.139729 Aug 19 09:21:24.250140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 341/719] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:24 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:24.289501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d4cfa47f-44fe-47d4-b2b5-9a289ced0432 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:24.290214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d4cfa47f-44fe-47d4-b2b5-9a289ced0432 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:24.296482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4cfa47f-44fe-47d4-b2b5-9a289ced0432 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:24.296921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4cfa47f-44fe-47d4-b2b5-9a289ced0432 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:24.297667 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4cfa47f-44fe-47d4-b2b5-9a289ced0432 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:24.298098 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4cfa47f-44fe-47d4-b2b5-9a289ced0432 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:24.318366 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d87a7a86-590d-4ddb-97b8-c6438cf6ba74 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:24.319470 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d87a7a86-590d-4ddb-97b8-c6438cf6ba74 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:24.325141 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d87a7a86-590d-4ddb-97b8-c6438cf6ba74 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:24.325593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d87a7a86-590d-4ddb-97b8-c6438cf6ba74 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:24.326373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d87a7a86-590d-4ddb-97b8-c6438cf6ba74 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:24.326810 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d87a7a86-590d-4ddb-97b8-c6438cf6ba74 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:24.356861 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d87a7a86-590d-4ddb-97b8-c6438cf6ba74 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042741 Aug 19 09:21:24.357358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 342/720] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:24 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:21:24.422109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d4cfa47f-44fe-47d4-b2b5-9a289ced0432 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:24.429814 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d4cfa47f-44fe-47d4-b2b5-9a289ced0432 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.144313 Aug 19 09:21:24.430374 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 379/721] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:24 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:24.907761 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-41fa0c52-481c-4db0-9355-3e37ce3b812b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:24.908699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-41fa0c52-481c-4db0-9355-3e37ce3b812b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:24.915378 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-41fa0c52-481c-4db0-9355-3e37ce3b812b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:24.915821 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-41fa0c52-481c-4db0-9355-3e37ce3b812b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:24.916580 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-41fa0c52-481c-4db0-9355-3e37ce3b812b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:24.917009 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-41fa0c52-481c-4db0-9355-3e37ce3b812b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:25.266730 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f238452a-7639-4c62-b9ab-fb2adf04e48d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:25.267294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f238452a-7639-4c62-b9ab-fb2adf04e48d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:25.273947 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f238452a-7639-4c62-b9ab-fb2adf04e48d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:25.274394 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f238452a-7639-4c62-b9ab-fb2adf04e48d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:25.275159 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f238452a-7639-4c62-b9ab-fb2adf04e48d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:25.275616 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f238452a-7639-4c62-b9ab-fb2adf04e48d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:25.397324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f238452a-7639-4c62-b9ab-fb2adf04e48d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:25.404442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f238452a-7639-4c62-b9ab-fb2adf04e48d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.141390 Aug 19 09:21:25.404998 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 380/722] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:25 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:25.409401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1b648068-ddb5-4fa3-8a67-9cf9ace11ec8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:25.410295 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1b648068-ddb5-4fa3-8a67-9cf9ace11ec8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:25.416168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1b648068-ddb5-4fa3-8a67-9cf9ace11ec8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:25.416612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1b648068-ddb5-4fa3-8a67-9cf9ace11ec8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:25.417373 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1b648068-ddb5-4fa3-8a67-9cf9ace11ec8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:25.417806 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1b648068-ddb5-4fa3-8a67-9cf9ace11ec8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:25.445722 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1b648068-ddb5-4fa3-8a67-9cf9ace11ec8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039681 Aug 19 09:21:25.446253 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 381/723] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:25 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:25.450402 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-64c8e922-7ae7-4c5c-a6c8-25ce63a7ba91 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:25.451000 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-64c8e922-7ae7-4c5c-a6c8-25ce63a7ba91 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:25.456231 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64c8e922-7ae7-4c5c-a6c8-25ce63a7ba91 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:25.456674 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64c8e922-7ae7-4c5c-a6c8-25ce63a7ba91 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:25.457427 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64c8e922-7ae7-4c5c-a6c8-25ce63a7ba91 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:25.457858 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64c8e922-7ae7-4c5c-a6c8-25ce63a7ba91 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:25.577213 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-64c8e922-7ae7-4c5c-a6c8-25ce63a7ba91 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:25.584932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-64c8e922-7ae7-4c5c-a6c8-25ce63a7ba91 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.137773 Aug 19 09:21:25.585489 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 382/724] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:25 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:26.421575 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1111d250-d87f-4e30-b640-91c81776b586 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:26.422215 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1111d250-d87f-4e30-b640-91c81776b586 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:26.429152 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1111d250-d87f-4e30-b640-91c81776b586 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:26.429600 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1111d250-d87f-4e30-b640-91c81776b586 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:26.430368 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1111d250-d87f-4e30-b640-91c81776b586 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:26.430809 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1111d250-d87f-4e30-b640-91c81776b586 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:26.550803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1111d250-d87f-4e30-b640-91c81776b586 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:26.558510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1111d250-d87f-4e30-b640-91c81776b586 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.140714 Aug 19 09:21:26.559061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 383/725] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:26 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:26.563402 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2d0903af-0d92-4bd8-a20d-817baa58a735 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:26.564294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2d0903af-0d92-4bd8-a20d-817baa58a735 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:26.569599 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d0903af-0d92-4bd8-a20d-817baa58a735 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:26.570041 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d0903af-0d92-4bd8-a20d-817baa58a735 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:26.570793 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d0903af-0d92-4bd8-a20d-817baa58a735 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:26.571219 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d0903af-0d92-4bd8-a20d-817baa58a735 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:26.599699 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2d0903af-0d92-4bd8-a20d-817baa58a735 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038829 Aug 19 09:21:26.600421 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 384/726] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:26 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:26.604424 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-29a67b79-7dde-449c-863f-6727f72af188 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:26.605012 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-29a67b79-7dde-449c-863f-6727f72af188 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:26.610136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-29a67b79-7dde-449c-863f-6727f72af188 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:26.610576 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-29a67b79-7dde-449c-863f-6727f72af188 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:26.611349 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-29a67b79-7dde-449c-863f-6727f72af188 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:26.611798 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-29a67b79-7dde-449c-863f-6727f72af188 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:26.729161 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-29a67b79-7dde-449c-863f-6727f72af188 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:26.736258 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-29a67b79-7dde-449c-863f-6727f72af188 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.134940 Aug 19 09:21:26.736819 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 385/727] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:26 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:27.576897 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9e49b8d5-54a6-4c7e-a1c3-787444a563e5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:27.577545 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9e49b8d5-54a6-4c7e-a1c3-787444a563e5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:27.584095 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e49b8d5-54a6-4c7e-a1c3-787444a563e5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:27.584534 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e49b8d5-54a6-4c7e-a1c3-787444a563e5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:27.585291 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e49b8d5-54a6-4c7e-a1c3-787444a563e5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:27.585715 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e49b8d5-54a6-4c7e-a1c3-787444a563e5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:27.722278 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9e49b8d5-54a6-4c7e-a1c3-787444a563e5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:27.729618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9e49b8d5-54a6-4c7e-a1c3-787444a563e5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.157527 Aug 19 09:21:27.730169 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 386/728] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:27 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:27.734392 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-abf4db2d-78c3-4f68-a076-5c77aa937079 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:27.735281 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-abf4db2d-78c3-4f68-a076-5c77aa937079 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:27.741015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-abf4db2d-78c3-4f68-a076-5c77aa937079 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:27.741451 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-abf4db2d-78c3-4f68-a076-5c77aa937079 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:27.742201 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-abf4db2d-78c3-4f68-a076-5c77aa937079 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:27.742626 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-abf4db2d-78c3-4f68-a076-5c77aa937079 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:27.771447 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-abf4db2d-78c3-4f68-a076-5c77aa937079 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040262 Aug 19 09:21:27.771984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 387/729] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:27 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:27.776582 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7e89dd61-fa38-4b39-b3fd-8e5560af6145 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:27.777169 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7e89dd61-fa38-4b39-b3fd-8e5560af6145 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:27.782435 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7e89dd61-fa38-4b39-b3fd-8e5560af6145 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:27.782874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7e89dd61-fa38-4b39-b3fd-8e5560af6145 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:27.783657 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7e89dd61-fa38-4b39-b3fd-8e5560af6145 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:27.784083 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7e89dd61-fa38-4b39-b3fd-8e5560af6145 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:27.905304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7e89dd61-fa38-4b39-b3fd-8e5560af6145 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:27.913112 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7e89dd61-fa38-4b39-b3fd-8e5560af6145 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.140218 Aug 19 09:21:27.913665 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 388/730] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:27 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:28.746068 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c3777e72-d3f4-4722-b521-637ad475613d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:28.746663 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c3777e72-d3f4-4722-b521-637ad475613d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:28.752252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c3777e72-d3f4-4722-b521-637ad475613d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:28.752694 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c3777e72-d3f4-4722-b521-637ad475613d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:28.753448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c3777e72-d3f4-4722-b521-637ad475613d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:28.753875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c3777e72-d3f4-4722-b521-637ad475613d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:28.870770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c3777e72-d3f4-4722-b521-637ad475613d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:28.878910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c3777e72-d3f4-4722-b521-637ad475613d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.136540 Aug 19 09:21:28.879493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 389/731] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:28 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:28.880982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-41fa0c52-481c-4db0-9355-3e37ce3b812b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 3.976176 Aug 19 09:21:28.881987 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 343/732] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:24 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 3979 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:21:28.884844 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f02b96a1-f4b4-4056-9cb4-263b919e9b48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:28.885741 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f02b96a1-f4b4-4056-9cb4-263b919e9b48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:28.891330 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f02b96a1-f4b4-4056-9cb4-263b919e9b48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:28.891772 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f02b96a1-f4b4-4056-9cb4-263b919e9b48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:28.892936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f02b96a1-f4b4-4056-9cb4-263b919e9b48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:28.893369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f02b96a1-f4b4-4056-9cb4-263b919e9b48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:28.922441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f02b96a1-f4b4-4056-9cb4-263b919e9b48 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Aug 19 09:21:28.922974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 390/733] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:28 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:28.930355 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-fea1a7ca-1902-40ce-9f28-55188d2f4f2c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:28.931037 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-fea1a7ca-1902-40ce-9f28-55188d2f4f2c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:28.937321 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fea1a7ca-1902-40ce-9f28-55188d2f4f2c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:28.937759 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fea1a7ca-1902-40ce-9f28-55188d2f4f2c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:28.938511 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fea1a7ca-1902-40ce-9f28-55188d2f4f2c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:28.938939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fea1a7ca-1902-40ce-9f28-55188d2f4f2c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:29.057927 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-fea1a7ca-1902-40ce-9f28-55188d2f4f2c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:29.065098 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-fea1a7ca-1902-40ce-9f28-55188d2f4f2c tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.139212 Aug 19 09:21:29.068834 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 344/734] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:28 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:29.892712 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-73e0db26-2704-4471-9549-ac1158880ca2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:29.893621 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-73e0db26-2704-4471-9549-ac1158880ca2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:29.895854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0ce3e016-3eb7-4c3b-8f64-002fefbfde80 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:29.896464 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0ce3e016-3eb7-4c3b-8f64-002fefbfde80 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:29.899818 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-73e0db26-2704-4471-9549-ac1158880ca2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:29.900275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-73e0db26-2704-4471-9549-ac1158880ca2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:29.901045 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-73e0db26-2704-4471-9549-ac1158880ca2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:29.901476 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-73e0db26-2704-4471-9549-ac1158880ca2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:29.902121 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ce3e016-3eb7-4c3b-8f64-002fefbfde80 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:29.902563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ce3e016-3eb7-4c3b-8f64-002fefbfde80 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:29.903345 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ce3e016-3eb7-4c3b-8f64-002fefbfde80 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:29.903775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ce3e016-3eb7-4c3b-8f64-002fefbfde80 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:30.012533 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-73e0db26-2704-4471-9549-ac1158880ca2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.123464 Aug 19 09:21:30.013810 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 391/735] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:29 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:30.018618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1cbf519b-b484-4d1a-974a-6a3aa034d851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:30.019879 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1cbf519b-b484-4d1a-974a-6a3aa034d851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:30.030439 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0ce3e016-3eb7-4c3b-8f64-002fefbfde80 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:30.046034 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cbf519b-b484-4d1a-974a-6a3aa034d851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:30.046496 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cbf519b-b484-4d1a-974a-6a3aa034d851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:30.048442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cbf519b-b484-4d1a-974a-6a3aa034d851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:30.048891 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cbf519b-b484-4d1a-974a-6a3aa034d851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:30.052831 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0ce3e016-3eb7-4c3b-8f64-002fefbfde80 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.156228 Aug 19 09:21:30.053920 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 345/736] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:29 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:30.085227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-05c2c57a-3e40-4d3f-bfc6-94da7f3b2c09 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:30.085227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-05c2c57a-3e40-4d3f-bfc6-94da7f3b2c09 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:30.086066 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1cbf519b-b484-4d1a-974a-6a3aa034d851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071664 Aug 19 09:21:30.087054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 392/737] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:30 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:30.093963 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05c2c57a-3e40-4d3f-bfc6-94da7f3b2c09 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:30.094417 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05c2c57a-3e40-4d3f-bfc6-94da7f3b2c09 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:30.095201 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05c2c57a-3e40-4d3f-bfc6-94da7f3b2c09 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:30.095663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05c2c57a-3e40-4d3f-bfc6-94da7f3b2c09 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:30.233020 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-05c2c57a-3e40-4d3f-bfc6-94da7f3b2c09 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:30.240687 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-05c2c57a-3e40-4d3f-bfc6-94da7f3b2c09 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.159816 Aug 19 09:21:30.241402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 346/738] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:30 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:31.025252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-74923ccf-73cb-4bff-91be-0ff7a3a9122c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:31.026321 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-74923ccf-73cb-4bff-91be-0ff7a3a9122c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:31.032988 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74923ccf-73cb-4bff-91be-0ff7a3a9122c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:31.033447 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74923ccf-73cb-4bff-91be-0ff7a3a9122c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:31.034209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74923ccf-73cb-4bff-91be-0ff7a3a9122c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:31.034640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74923ccf-73cb-4bff-91be-0ff7a3a9122c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:31.070210 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1a6f8490-67ee-4093-91ca-ac3940e0e8ce tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:31.070826 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1a6f8490-67ee-4093-91ca-ac3940e0e8ce tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:31.076511 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1a6f8490-67ee-4093-91ca-ac3940e0e8ce tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:31.076964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1a6f8490-67ee-4093-91ca-ac3940e0e8ce tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:31.077723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1a6f8490-67ee-4093-91ca-ac3940e0e8ce tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:31.078159 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1a6f8490-67ee-4093-91ca-ac3940e0e8ce tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:31.195521 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1a6f8490-67ee-4093-91ca-ac3940e0e8ce tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:31.196944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-74923ccf-73cb-4bff-91be-0ff7a3a9122c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28591 microversion: 2.20 time: 0.175927 Aug 19 09:21:31.200813 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 393/739] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:31 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28591 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:31.202587 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-26c45663-a852-498a-9444-327b0878dc2a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:31.203598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-26c45663-a852-498a-9444-327b0878dc2a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:31.205413 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1a6f8490-67ee-4093-91ca-ac3940e0e8ce tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.139433 Aug 19 09:21:31.205982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 347/740] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:31 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:31.210513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-26c45663-a852-498a-9444-327b0878dc2a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:31.210951 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-26c45663-a852-498a-9444-327b0878dc2a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:31.211735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-26c45663-a852-498a-9444-327b0878dc2a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:31.212164 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-26c45663-a852-498a-9444-327b0878dc2a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:31.240739 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-26c45663-a852-498a-9444-327b0878dc2a tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041862 Aug 19 09:21:31.241446 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 394/741] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:21:31 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:21:31.256980 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0840ea0c-03fb-4296-a732-bb702f375aad tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:31.257592 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0840ea0c-03fb-4296-a732-bb702f375aad tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:31.263246 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0840ea0c-03fb-4296-a732-bb702f375aad tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:31.263726 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0840ea0c-03fb-4296-a732-bb702f375aad tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:31.264492 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0840ea0c-03fb-4296-a732-bb702f375aad tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:31.264924 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0840ea0c-03fb-4296-a732-bb702f375aad tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:31.394526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0840ea0c-03fb-4296-a732-bb702f375aad tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:31.402217 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0840ea0c-03fb-4296-a732-bb702f375aad tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.148903 Aug 19 09:21:31.402809 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 348/742] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:31 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:32.208173 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c2edddd8-4c2f-45b9-ab44-4cba8e79ed35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:32.209251 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c2edddd8-4c2f-45b9-ab44-4cba8e79ed35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:32.215259 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2edddd8-4c2f-45b9-ab44-4cba8e79ed35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:32.215722 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2edddd8-4c2f-45b9-ab44-4cba8e79ed35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:32.216553 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2edddd8-4c2f-45b9-ab44-4cba8e79ed35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:32.216988 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2edddd8-4c2f-45b9-ab44-4cba8e79ed35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:32.221442 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6f8ebcef-8820-4b96-88fb-928022326235 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:32.222055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6f8ebcef-8820-4b96-88fb-928022326235 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:32.228491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f8ebcef-8820-4b96-88fb-928022326235 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:32.228935 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f8ebcef-8820-4b96-88fb-928022326235 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:32.229701 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f8ebcef-8820-4b96-88fb-928022326235 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:32.230135 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f8ebcef-8820-4b96-88fb-928022326235 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:32.347041 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c2edddd8-4c2f-45b9-ab44-4cba8e79ed35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 28712 microversion: 2.20 time: 0.142362 Aug 19 09:21:32.349518 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 395/743] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:32 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 28712 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:32.350818 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6f8ebcef-8820-4b96-88fb-928022326235 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:32.358182 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6f8ebcef-8820-4b96-88fb-928022326235 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.140300 Aug 19 09:21:32.358725 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 349/744] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:32 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:32.420225 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cad6b369-bc25-40c4-9eb5-bdb645161ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:32.420914 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cad6b369-bc25-40c4-9eb5-bdb645161ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:32.427493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cad6b369-bc25-40c4-9eb5-bdb645161ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:32.427867 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cad6b369-bc25-40c4-9eb5-bdb645161ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:32.428629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cad6b369-bc25-40c4-9eb5-bdb645161ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:32.429056 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cad6b369-bc25-40c4-9eb5-bdb645161ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:32.445718 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-861163da-faa7-4f4e-9aa6-b862a8ffbc8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:32.446237 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-861163da-faa7-4f4e-9aa6-b862a8ffbc8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:32.451853 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-861163da-faa7-4f4e-9aa6-b862a8ffbc8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:32.452294 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-861163da-faa7-4f4e-9aa6-b862a8ffbc8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:32.453057 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-861163da-faa7-4f4e-9aa6-b862a8ffbc8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:32.453487 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-861163da-faa7-4f4e-9aa6-b862a8ffbc8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:32.479139 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-861163da-faa7-4f4e-9aa6-b862a8ffbc8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:21:32.551531 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cad6b369-bc25-40c4-9eb5-bdb645161ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:32.554634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-861163da-faa7-4f4e-9aa6-b862a8ffbc8c tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 204 len: 0 microversion: 2.1 time: 0.112561 Aug 19 09:21:32.555261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 350/745] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:21:32 2021] DELETE /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 09:21:32.560339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cad6b369-bc25-40c4-9eb5-bdb645161ad1 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.143844 Aug 19 09:21:32.561155 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 396/746] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:32 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:32.564022 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0a9c655f-1cd9-4529-a22e-66e4c139c96f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:32.565191 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0a9c655f-1cd9-4529-a22e-66e4c139c96f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:32.572165 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a9c655f-1cd9-4529-a22e-66e4c139c96f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:32.572610 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a9c655f-1cd9-4529-a22e-66e4c139c96f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:32.573377 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a9c655f-1cd9-4529-a22e-66e4c139c96f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:32.573809 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0a9c655f-1cd9-4529-a22e-66e4c139c96f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:32.695969 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0a9c655f-1cd9-4529-a22e-66e4c139c96f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:32.703008 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0a9c655f-1cd9-4529-a22e-66e4c139c96f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1514 microversion: 2.1 time: 0.143368 Aug 19 09:21:32.703601 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 351/747] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:32 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:33.051409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-a24b1f67-3538-456f-bcd2-e473982c9237 req-fb0d91b5-9651-4f7f-9208-ae23e6a31d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db6043f-4b5d-4736-9623-cc4a3220ba35", "name": "network-vif-plugged", "status": "completed", "tag": "a57e9f7c-c1f7-45a1-a64e-e8297bcf8c36"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:33.053482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:33.053482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:21:33.060530 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-a24b1f67-3538-456f-bcd2-e473982c9237 req-fb0d91b5-9651-4f7f-9208-ae23e6a31d9a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:33.060956 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-a24b1f67-3538-456f-bcd2-e473982c9237 req-fb0d91b5-9651-4f7f-9208-ae23e6a31d9a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:33.071766 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-a24b1f67-3538-456f-bcd2-e473982c9237 req-fb0d91b5-9651-4f7f-9208-ae23e6a31d9a service nova] Creating event network-vif-plugged:a57e9f7c-c1f7-45a1-a64e-e8297bcf8c36 for instance 2db6043f-4b5d-4736-9623-cc4a3220ba35 on hv-cinder-77387 Aug 19 09:21:33.076572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-a24b1f67-3538-456f-bcd2-e473982c9237 req-fb0d91b5-9651-4f7f-9208-ae23e6a31d9a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028821 Aug 19 09:21:33.077146 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 397/748] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:21:33.359653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c8280c79-d677-4394-add9-9c24aef5d66f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:33.360712 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c8280c79-d677-4394-add9-9c24aef5d66f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:33.367558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c8280c79-d677-4394-add9-9c24aef5d66f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:33.367997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c8280c79-d677-4394-add9-9c24aef5d66f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:33.370092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c8280c79-d677-4394-add9-9c24aef5d66f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:33.370092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c8280c79-d677-4394-add9-9c24aef5d66f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:33.375590 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7632313e-851a-4dc7-8e56-f785fde3ab63 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:33.376368 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7632313e-851a-4dc7-8e56-f785fde3ab63 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:33.383306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7632313e-851a-4dc7-8e56-f785fde3ab63 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:33.383954 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7632313e-851a-4dc7-8e56-f785fde3ab63 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:33.384744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7632313e-851a-4dc7-8e56-f785fde3ab63 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:33.385183 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7632313e-851a-4dc7-8e56-f785fde3ab63 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:33.510987 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7632313e-851a-4dc7-8e56-f785fde3ab63 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:33.518601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7632313e-851a-4dc7-8e56-f785fde3ab63 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.147101 Aug 19 09:21:33.519162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 398/749] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:33 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:33.524532 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c8280c79-d677-4394-add9-9c24aef5d66f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 30111 microversion: 2.20 time: 0.168984 Aug 19 09:21:33.529055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 352/750] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:33 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 30111 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:33.577600 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1c9c48e5-86f3-4d22-ab14-0d5c0b218429 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:33.578158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1c9c48e5-86f3-4d22-ab14-0d5c0b218429 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:33.584358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1c9c48e5-86f3-4d22-ab14-0d5c0b218429 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:33.584795 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1c9c48e5-86f3-4d22-ab14-0d5c0b218429 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:33.585551 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1c9c48e5-86f3-4d22-ab14-0d5c0b218429 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:33.585976 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1c9c48e5-86f3-4d22-ab14-0d5c0b218429 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:33.705957 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1c9c48e5-86f3-4d22-ab14-0d5c0b218429 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:33.713598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1c9c48e5-86f3-4d22-ab14-0d5c0b218429 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1523 microversion: 2.1 time: 0.139666 Aug 19 09:21:33.714156 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 399/751] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:33 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1523 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:33.720415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-40aed8c2-2dab-49b9-998a-95eb433802f8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:33.721137 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-40aed8c2-2dab-49b9-998a-95eb433802f8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:33.728443 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-40aed8c2-2dab-49b9-998a-95eb433802f8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:33.728885 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-40aed8c2-2dab-49b9-998a-95eb433802f8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:33.729644 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-40aed8c2-2dab-49b9-998a-95eb433802f8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:33.730075 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-40aed8c2-2dab-49b9-998a-95eb433802f8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:33.847216 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-40aed8c2-2dab-49b9-998a-95eb433802f8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:33.854552 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-40aed8c2-2dab-49b9-998a-95eb433802f8 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1514 microversion: 2.1 time: 0.138112 Aug 19 09:21:33.855113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 353/752] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:33 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1514 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:34.536030 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-41416288-5c34-46bd-8bed-7ac86fc312cf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:34.536608 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-62d6577a-f51d-4d31-b09c-ce2f9d7b6f75 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:34.536968 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-62d6577a-f51d-4d31-b09c-ce2f9d7b6f75 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:34.537413 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-41416288-5c34-46bd-8bed-7ac86fc312cf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:34.543947 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41416288-5c34-46bd-8bed-7ac86fc312cf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:34.544481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41416288-5c34-46bd-8bed-7ac86fc312cf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:34.545497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41416288-5c34-46bd-8bed-7ac86fc312cf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:34.545982 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41416288-5c34-46bd-8bed-7ac86fc312cf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:34.546772 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62d6577a-f51d-4d31-b09c-ce2f9d7b6f75 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:34.547222 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62d6577a-f51d-4d31-b09c-ce2f9d7b6f75 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:34.548015 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62d6577a-f51d-4d31-b09c-ce2f9d7b6f75 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:34.548440 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62d6577a-f51d-4d31-b09c-ce2f9d7b6f75 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:34.749994 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-62d6577a-f51d-4d31-b09c-ce2f9d7b6f75 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:34.755812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-41416288-5c34-46bd-8bed-7ac86fc312cf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 31622 microversion: 2.20 time: 0.222772 Aug 19 09:21:34.757582 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 400/753] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:34 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 31622 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:34.758116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-62d6577a-f51d-4d31-b09c-ce2f9d7b6f75 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1319 microversion: 2.1 time: 0.225454 Aug 19 09:21:34.758681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 354/754] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:34 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:34.762978 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:34.763199 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-4d2d1308-78b4-4e1f-9f6f-e49be9e42e9a req-5c7b72ad-7e14-42ab-b22a-aaf410a7f628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c3bc8f-45ae-4a40-8a3d-d9642d8728df", "name": "network-vif-deleted", "tag": "ac485851-543b-4b61-ba46-32cc68fcf2c4"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:34.763603 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:34.764932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:34.764932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:21:34.769282 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:34.769807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:34.770586 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:34.771677 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:34.772903 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-4d2d1308-78b4-4e1f-9f6f-e49be9e42e9a req-5c7b72ad-7e14-42ab-b22a-aaf410a7f628 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:34.773340 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-4d2d1308-78b4-4e1f-9f6f-e49be9e42e9a req-5c7b72ad-7e14-42ab-b22a-aaf410a7f628 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:34.785168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-4d2d1308-78b4-4e1f-9f6f-e49be9e42e9a req-5c7b72ad-7e14-42ab-b22a-aaf410a7f628 service nova] Creating event network-vif-deleted:ac485851-543b-4b61-ba46-32cc68fcf2c4 for instance f4c3bc8f-45ae-4a40-8a3d-d9642d8728df on hv-cinder-77387 Aug 19 09:21:34.790343 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-4d2d1308-78b4-4e1f-9f6f-e49be9e42e9a req-5c7b72ad-7e14-42ab-b22a-aaf410a7f628 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 Aug 19 09:21:34.790938 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 401/755] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:34.808825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:34.809268 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:34.809708 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lazy-loading 'fault' on Instance uuid f4c3bc8f-45ae-4a40-8a3d-d9642d8728df {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:21:34.871717 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d6e9825d-b770-4a24-97d4-4b8e5327b9dd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:34.872318 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d6e9825d-b770-4a24-97d4-4b8e5327b9dd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:34.878226 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d6e9825d-b770-4a24-97d4-4b8e5327b9dd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:34.878667 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d6e9825d-b770-4a24-97d4-4b8e5327b9dd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:34.879470 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d6e9825d-b770-4a24-97d4-4b8e5327b9dd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:34.879896 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d6e9825d-b770-4a24-97d4-4b8e5327b9dd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:34.886280 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6694bf551f214f6e851cd166a4161495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12ed2bcdb61430986f3980ed2e7a8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:34.893757 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-78aab871-c4af-45b5-be1d-363ddd041cfa tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 200 len: 1312 microversion: 2.1 time: 0.134137 Aug 19 09:21:34.894436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 355/756] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:34 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:35.006304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d6e9825d-b770-4a24-97d4-4b8e5327b9dd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:35.013494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d6e9825d-b770-4a24-97d4-4b8e5327b9dd tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1514 microversion: 2.1 time: 0.145854 Aug 19 09:21:35.014045 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 402/757] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:34 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:35.767677 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6bfdb935-c2dc-4dbd-9e35-b9dd7400c6af tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:35.768616 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6bfdb935-c2dc-4dbd-9e35-b9dd7400c6af tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:35.774569 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4bd10cc8-0f00-47fc-86a3-7c90d80bf2ff tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:35.775318 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4bd10cc8-0f00-47fc-86a3-7c90d80bf2ff tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:35.775444 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6bfdb935-c2dc-4dbd-9e35-b9dd7400c6af tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:35.775835 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6bfdb935-c2dc-4dbd-9e35-b9dd7400c6af tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:35.776595 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6bfdb935-c2dc-4dbd-9e35-b9dd7400c6af tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:35.777032 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6bfdb935-c2dc-4dbd-9e35-b9dd7400c6af tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:35.788618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4bd10cc8-0f00-47fc-86a3-7c90d80bf2ff tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:35.789203 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4bd10cc8-0f00-47fc-86a3-7c90d80bf2ff tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:35.790086 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4bd10cc8-0f00-47fc-86a3-7c90d80bf2ff tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:35.790718 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4bd10cc8-0f00-47fc-86a3-7c90d80bf2ff tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:35.929435 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6bfdb935-c2dc-4dbd-9e35-b9dd7400c6af tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 32652 microversion: 2.20 time: 0.165066 Aug 19 09:21:35.929630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4bd10cc8-0f00-47fc-86a3-7c90d80bf2ff tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:35.930015 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 356/758] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:35 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 32652 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:35.935602 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-828628a2-fd00-4c61-8c5e-ae01545c4eb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:35.936559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-828628a2-fd00-4c61-8c5e-ae01545c4eb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] [instance: f4c3bc8f-45ae-4a40-8a3d-d9642d8728df] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:35.938013 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4bd10cc8-0f00-47fc-86a3-7c90d80bf2ff tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1508 microversion: 2.1 time: 0.167894 Aug 19 09:21:35.943351 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-828628a2-fd00-4c61-8c5e-ae01545c4eb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:35.943796 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-828628a2-fd00-4c61-8c5e-ae01545c4eb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:35.944738 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-828628a2-fd00-4c61-8c5e-ae01545c4eb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:35.945175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-828628a2-fd00-4c61-8c5e-ae01545c4eb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:35.947863 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 403/759] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:35 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:35.960755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-828628a2-fd00-4c61-8c5e-ae01545c4eb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] HTTP exception thrown: Instance f4c3bc8f-45ae-4a40-8a3d-d9642d8728df could not be found. Aug 19 09:21:35.961359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-828628a2-fd00-4c61-8c5e-ae01545c4eb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] Returning 404 to user: Instance f4c3bc8f-45ae-4a40-8a3d-d9642d8728df could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:21:35.962199 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-828628a2-fd00-4c61-8c5e-ae01545c4eb5 tempest-ServerRescueNegativeTestJSON-1477903775 tempest-ServerRescueNegativeTestJSON-1477903775-project] 10.222.0.32 "GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df" status: 404 len: 111 microversion: 2.1 time: 0.030941 Aug 19 09:21:35.962760 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 357/760] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:35 2021] GET /compute/v2.1/servers/f4c3bc8f-45ae-4a40-8a3d-d9642d8728df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:21:36.031812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3a2583d6-bb3d-4fc5-a41c-3ba64cbfad57 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:36.034219 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3a2583d6-bb3d-4fc5-a41c-3ba64cbfad57 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:36.048065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a2583d6-bb3d-4fc5-a41c-3ba64cbfad57 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:36.048601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a2583d6-bb3d-4fc5-a41c-3ba64cbfad57 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:36.049387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a2583d6-bb3d-4fc5-a41c-3ba64cbfad57 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:36.049825 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a2583d6-bb3d-4fc5-a41c-3ba64cbfad57 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:36.283506 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3a2583d6-bb3d-4fc5-a41c-3ba64cbfad57 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:36.292046 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3a2583d6-bb3d-4fc5-a41c-3ba64cbfad57 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1514 microversion: 2.1 time: 0.265976 Aug 19 09:21:36.292654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 404/761] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:36 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:36.941628 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9c1a6c8b-322d-4434-87ed-df23a5ab9591 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:36.943783 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9c1a6c8b-322d-4434-87ed-df23a5ab9591 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:36.953335 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c1a6c8b-322d-4434-87ed-df23a5ab9591 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:36.954130 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c1a6c8b-322d-4434-87ed-df23a5ab9591 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:36.955162 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c1a6c8b-322d-4434-87ed-df23a5ab9591 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:36.955823 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c1a6c8b-322d-4434-87ed-df23a5ab9591 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:36.986725 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-8d95c176-a613-492e-a12d-c81a134df794 req-41945d00-516f-4f51-b2ea-618a97593a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7db7988b-5e66-43cd-8e4a-d32b1b29786b", "name": "network-vif-deleted", "tag": "a75a2d3b-a5ee-46a2-88d4-3c5ae8cb26fb"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:36.988694 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:36.988694 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:21:37.002026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-8d95c176-a613-492e-a12d-c81a134df794 req-41945d00-516f-4f51-b2ea-618a97593a6b service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:37.002638 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-8d95c176-a613-492e-a12d-c81a134df794 req-41945d00-516f-4f51-b2ea-618a97593a6b service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:37.019996 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-8d95c176-a613-492e-a12d-c81a134df794 req-41945d00-516f-4f51-b2ea-618a97593a6b service nova] Creating event network-vif-deleted:a75a2d3b-a5ee-46a2-88d4-3c5ae8cb26fb for instance 7db7988b-5e66-43cd-8e4a-d32b1b29786b on hv-cinder-77387 Aug 19 09:21:37.026828 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-8d95c176-a613-492e-a12d-c81a134df794 req-41945d00-516f-4f51-b2ea-618a97593a6b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044632 Aug 19 09:21:37.027581 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 405/762] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:21:37.207432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9c1a6c8b-322d-4434-87ed-df23a5ab9591 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 33371 microversion: 2.20 time: 0.269690 Aug 19 09:21:37.208182 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 358/763] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:36 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 33371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:37.309204 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:37.309815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:37.316039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:37.316698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:37.317735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:37.318426 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:37.357957 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:37.358488 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:37.359009 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lazy-loading 'fault' on Instance uuid 7db7988b-5e66-43cd-8e4a-d32b1b29786b {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:21:37.634755 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:37.642283 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d4b70693-8d8b-470c-91f4-1e37df14ef7d tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 200 len: 1308 microversion: 2.1 time: 0.337202 Aug 19 09:21:37.642966 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 406/764] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:37 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 1308 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:38.220572 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1c139cb1-4b28-493a-87f3-34e744ab4718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:38.222231 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1c139cb1-4b28-493a-87f3-34e744ab4718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:38.229781 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1c139cb1-4b28-493a-87f3-34e744ab4718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:38.230226 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1c139cb1-4b28-493a-87f3-34e744ab4718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:38.230987 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1c139cb1-4b28-493a-87f3-34e744ab4718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:38.231576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1c139cb1-4b28-493a-87f3-34e744ab4718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:38.385890 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1c139cb1-4b28-493a-87f3-34e744ab4718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 34060 microversion: 2.20 time: 0.169152 Aug 19 09:21:38.387215 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 359/765] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:38 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 34060 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:38.659030 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b1b312b5-1c62-4eb2-9c0f-b87994f103b9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:38.659861 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b1b312b5-1c62-4eb2-9c0f-b87994f103b9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 7db7988b-5e66-43cd-8e4a-d32b1b29786b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:38.666127 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1b312b5-1c62-4eb2-9c0f-b87994f103b9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:38.666573 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1b312b5-1c62-4eb2-9c0f-b87994f103b9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:38.667373 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1b312b5-1c62-4eb2-9c0f-b87994f103b9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:38.667808 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1b312b5-1c62-4eb2-9c0f-b87994f103b9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:38.682804 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-b1b312b5-1c62-4eb2-9c0f-b87994f103b9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] HTTP exception thrown: Instance 7db7988b-5e66-43cd-8e4a-d32b1b29786b could not be found. Aug 19 09:21:38.683433 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b1b312b5-1c62-4eb2-9c0f-b87994f103b9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Returning 404 to user: Instance 7db7988b-5e66-43cd-8e4a-d32b1b29786b could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:21:38.684273 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b1b312b5-1c62-4eb2-9c0f-b87994f103b9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b" status: 404 len: 111 microversion: 2.1 time: 0.028963 Aug 19 09:21:38.684824 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 407/766] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:38 2021] GET /compute/v2.1/servers/7db7988b-5e66-43cd-8e4a-d32b1b29786b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:21:39.400305 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5d0da9c9-08c1-4772-8f68-d2cd5d2bd4f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:39.406701 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5d0da9c9-08c1-4772-8f68-d2cd5d2bd4f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:39.417931 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5d0da9c9-08c1-4772-8f68-d2cd5d2bd4f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:39.418736 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5d0da9c9-08c1-4772-8f68-d2cd5d2bd4f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:39.419916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5d0da9c9-08c1-4772-8f68-d2cd5d2bd4f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:39.420597 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5d0da9c9-08c1-4772-8f68-d2cd5d2bd4f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:39.550094 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5d0da9c9-08c1-4772-8f68-d2cd5d2bd4f0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 35074 microversion: 2.20 time: 0.155120 Aug 19 09:21:39.551528 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 360/767] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:39 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 35074 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:39.842294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-faa33b2d-52eb-4534-b673-3b7e85b9d7ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:39.842787 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-faa33b2d-52eb-4534-b673-3b7e85b9d7ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:39.848935 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-faa33b2d-52eb-4534-b673-3b7e85b9d7ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:39.849956 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-faa33b2d-52eb-4534-b673-3b7e85b9d7ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:39.850774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-faa33b2d-52eb-4534-b673-3b7e85b9d7ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:39.851435 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-faa33b2d-52eb-4534-b673-3b7e85b9d7ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:39.876596 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-faa33b2d-52eb-4534-b673-3b7e85b9d7ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Going to try to terminate instance {{(pid=107957) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:21:39.957494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-faa33b2d-52eb-4534-b673-3b7e85b9d7ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "DELETE /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 204 len: 0 microversion: 2.1 time: 0.118532 Aug 19 09:21:39.958974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 408/768] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:21:39 2021] DELETE /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:21:39.967781 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-223bc1c3-1268-4476-8624-06a1868950d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:39.968482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-223bc1c3-1268-4476-8624-06a1868950d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:39.975141 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-223bc1c3-1268-4476-8624-06a1868950d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:39.975908 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-223bc1c3-1268-4476-8624-06a1868950d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:39.976885 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-223bc1c3-1268-4476-8624-06a1868950d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:39.977325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-223bc1c3-1268-4476-8624-06a1868950d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:40.107423 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-223bc1c3-1268-4476-8624-06a1868950d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:40.114708 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-223bc1c3-1268-4476-8624-06a1868950d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1514 microversion: 2.1 time: 0.151383 Aug 19 09:21:40.115532 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 361/769] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:39 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:40.562541 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-929be0e4-76f4-46ef-8d26-46dc742d3611 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:40.563558 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-929be0e4-76f4-46ef-8d26-46dc742d3611 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:40.569510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-929be0e4-76f4-46ef-8d26-46dc742d3611 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:40.569954 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-929be0e4-76f4-46ef-8d26-46dc742d3611 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:40.570714 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-929be0e4-76f4-46ef-8d26-46dc742d3611 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:40.571138 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-929be0e4-76f4-46ef-8d26-46dc742d3611 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:40.685370 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-929be0e4-76f4-46ef-8d26-46dc742d3611 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 35855 microversion: 2.20 time: 0.126657 Aug 19 09:21:40.686014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 409/770] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:40 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 35855 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:41.131485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d55d4273-2b24-44af-86e0-b29aa1e54e37 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:41.132100 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d55d4273-2b24-44af-86e0-b29aa1e54e37 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:41.138454 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d55d4273-2b24-44af-86e0-b29aa1e54e37 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:41.138900 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d55d4273-2b24-44af-86e0-b29aa1e54e37 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:41.139693 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d55d4273-2b24-44af-86e0-b29aa1e54e37 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:41.140130 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d55d4273-2b24-44af-86e0-b29aa1e54e37 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:41.293780 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d55d4273-2b24-44af-86e0-b29aa1e54e37 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:41.301151 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d55d4273-2b24-44af-86e0-b29aa1e54e37 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1514 microversion: 2.1 time: 0.173358 Aug 19 09:21:41.301700 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 362/771] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:41 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:41.698556 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-aa2cdff2-344c-4d7c-bf77-968a6336f3d8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:41.700339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-aa2cdff2-344c-4d7c-bf77-968a6336f3d8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:41.707329 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-aa2cdff2-344c-4d7c-bf77-968a6336f3d8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:41.708103 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-aa2cdff2-344c-4d7c-bf77-968a6336f3d8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:41.709131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-aa2cdff2-344c-4d7c-bf77-968a6336f3d8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:41.709816 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-aa2cdff2-344c-4d7c-bf77-968a6336f3d8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:41.832681 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-aa2cdff2-344c-4d7c-bf77-968a6336f3d8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 36756 microversion: 2.20 time: 0.135931 Aug 19 09:21:41.834835 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 410/772] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:41 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 36756 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:42.317836 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7c1659a8-c3a1-4c1c-919e-b8315a55fcb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:42.318489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7c1659a8-c3a1-4c1c-919e-b8315a55fcb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:42.324292 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c1659a8-c3a1-4c1c-919e-b8315a55fcb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:42.324741 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c1659a8-c3a1-4c1c-919e-b8315a55fcb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:42.325611 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c1659a8-c3a1-4c1c-919e-b8315a55fcb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:42.326111 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c1659a8-c3a1-4c1c-919e-b8315a55fcb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:42.464739 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7c1659a8-c3a1-4c1c-919e-b8315a55fcb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:42.475648 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7c1659a8-c3a1-4c1c-919e-b8315a55fcb7 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1514 microversion: 2.1 time: 0.161414 Aug 19 09:21:42.485654 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 363/773] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:42 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:42.853416 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1991b119-0e4c-4ce5-add4-15e81d7a54f5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:42.856199 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1991b119-0e4c-4ce5-add4-15e81d7a54f5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:42.865057 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1991b119-0e4c-4ce5-add4-15e81d7a54f5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:42.866031 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1991b119-0e4c-4ce5-add4-15e81d7a54f5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:42.867048 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1991b119-0e4c-4ce5-add4-15e81d7a54f5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:42.867735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1991b119-0e4c-4ce5-add4-15e81d7a54f5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:42.984569 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1991b119-0e4c-4ce5-add4-15e81d7a54f5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 37935 microversion: 2.20 time: 0.142500 Aug 19 09:21:42.985847 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 411/774] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:42 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 37935 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:43.034700 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-2f17588c-1f81-4814-9543-711ca971eeb9 req-189798c5-7c37-43fc-b203-820df244a2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770a9eff-164f-464b-9ddc-85d731650432", "name": "network-vif-deleted", "tag": "926dae50-59d9-47b4-9b81-d532dbdc9892"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:43.038682 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:43.038682 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:21:43.046952 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-2f17588c-1f81-4814-9543-711ca971eeb9 req-189798c5-7c37-43fc-b203-820df244a2e6 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:43.047448 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-2f17588c-1f81-4814-9543-711ca971eeb9 req-189798c5-7c37-43fc-b203-820df244a2e6 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:43.066820 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-2f17588c-1f81-4814-9543-711ca971eeb9 req-189798c5-7c37-43fc-b203-820df244a2e6 service nova] Creating event network-vif-deleted:926dae50-59d9-47b4-9b81-d532dbdc9892 for instance 770a9eff-164f-464b-9ddc-85d731650432 on hv-cinder-77387 Aug 19 09:21:43.072564 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-2f17588c-1f81-4814-9543-711ca971eeb9 req-189798c5-7c37-43fc-b203-820df244a2e6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044362 Aug 19 09:21:43.073156 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 364/775] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:21:43.493511 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:43.501974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:43.515880 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:43.518442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:43.519534 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:43.520419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:43.597525 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:43.599030 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:43.600637 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lazy-loading 'fault' on Instance uuid 770a9eff-164f-464b-9ddc-85d731650432 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:21:43.660601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:43.672732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0db6e171-195e-401e-affa-6c3e0f7c4851 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 200 len: 1307 microversion: 2.1 time: 0.183083 Aug 19 09:21:43.682925 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 412/776] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:43 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 1307 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:44.003651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-65884945-4526-4cd4-9d8c-010e94e0c757 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:44.005414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-65884945-4526-4cd4-9d8c-010e94e0c757 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:44.013217 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65884945-4526-4cd4-9d8c-010e94e0c757 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:44.013728 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65884945-4526-4cd4-9d8c-010e94e0c757 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:44.014590 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65884945-4526-4cd4-9d8c-010e94e0c757 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:44.015249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65884945-4526-4cd4-9d8c-010e94e0c757 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:44.206796 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-65884945-4526-4cd4-9d8c-010e94e0c757 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 38122 microversion: 2.20 time: 0.212825 Aug 19 09:21:44.208681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 365/777] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:43 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 38122 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:44.690137 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7a747146-c952-40de-bf59-3742abf20ce3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:44.690870 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7a747146-c952-40de-bf59-3742abf20ce3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 770a9eff-164f-464b-9ddc-85d731650432] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:44.697637 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7a747146-c952-40de-bf59-3742abf20ce3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:44.698156 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7a747146-c952-40de-bf59-3742abf20ce3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:44.699003 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7a747146-c952-40de-bf59-3742abf20ce3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:44.699571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7a747146-c952-40de-bf59-3742abf20ce3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:44.712920 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-7a747146-c952-40de-bf59-3742abf20ce3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] HTTP exception thrown: Instance 770a9eff-164f-464b-9ddc-85d731650432 could not be found. Aug 19 09:21:44.713604 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7a747146-c952-40de-bf59-3742abf20ce3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Returning 404 to user: Instance 770a9eff-164f-464b-9ddc-85d731650432 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:21:44.714630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7a747146-c952-40de-bf59-3742abf20ce3 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432" status: 404 len: 111 microversion: 2.1 time: 0.028328 Aug 19 09:21:44.715322 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 413/778] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:44 2021] GET /compute/v2.1/servers/770a9eff-164f-464b-9ddc-85d731650432 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:21:44.726830 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-16892cd5-5ca3-49ed-a257-c5c74c3e18ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:44.727458 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-16892cd5-5ca3-49ed-a257-c5c74c3e18ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:44.733651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16892cd5-5ca3-49ed-a257-c5c74c3e18ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:44.734394 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16892cd5-5ca3-49ed-a257-c5c74c3e18ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:44.735306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16892cd5-5ca3-49ed-a257-c5c74c3e18ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:44.736003 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16892cd5-5ca3-49ed-a257-c5c74c3e18ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:44.772258 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-16892cd5-5ca3-49ed-a257-c5c74c3e18ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:21:44.862808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-16892cd5-5ca3-49ed-a257-c5c74c3e18ac tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 204 len: 0 microversion: 2.1 time: 0.141770 Aug 19 09:21:44.862808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 366/779] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:21:44 2021] DELETE /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:21:44.871837 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-18413240-8114-4c1b-81e0-d0038d095ecc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:44.872533 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-18413240-8114-4c1b-81e0-d0038d095ecc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:44.884539 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18413240-8114-4c1b-81e0-d0038d095ecc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:44.885048 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18413240-8114-4c1b-81e0-d0038d095ecc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:44.886083 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18413240-8114-4c1b-81e0-d0038d095ecc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:44.886587 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18413240-8114-4c1b-81e0-d0038d095ecc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:45.035003 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-18413240-8114-4c1b-81e0-d0038d095ecc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:45.043561 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-18413240-8114-4c1b-81e0-d0038d095ecc tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1514 microversion: 2.1 time: 0.175253 Aug 19 09:21:45.053271 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 414/780] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:44 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:45.061287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-469f4e7d-336f-4c3e-b6ad-bb614849101d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'create', calling method: .version_select at 0x7fdb80713ee0>, body: {"keypair": {"name": "tempest-keypair-1175985524"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:45.078345 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-469f4e7d-336f-4c3e-b6ad-bb614849101d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for project d19c107f773440eb8c2ab26706bc3591. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:21:45.081997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-469f4e7d-336f-4c3e-b6ad-bb614849101d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for user 4775744e6880427c8e91e67afe713052 and project d19c107f773440eb8c2ab26706bc3591. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:21:45.220212 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9104eb15-5e7d-48ec-90b7-ef86da7ee1be tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:45.221198 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9104eb15-5e7d-48ec-90b7-ef86da7ee1be tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:45.235348 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9104eb15-5e7d-48ec-90b7-ef86da7ee1be tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:45.235937 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9104eb15-5e7d-48ec-90b7-ef86da7ee1be tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:45.236820 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9104eb15-5e7d-48ec-90b7-ef86da7ee1be tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:45.237155 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9104eb15-5e7d-48ec-90b7-ef86da7ee1be tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:45.336273 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-469f4e7d-336f-4c3e-b6ad-bb614849101d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for project d19c107f773440eb8c2ab26706bc3591. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:21:45.339037 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9104eb15-5e7d-48ec-90b7-ef86da7ee1be tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 38122 microversion: 2.20 time: 0.122295 Aug 19 09:21:45.339965 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 415/781] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:45 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 38122 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:21:45.340122 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-469f4e7d-336f-4c3e-b6ad-bb614849101d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for user 4775744e6880427c8e91e67afe713052 and project d19c107f773440eb8c2ab26706bc3591. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:21:45.357724 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-469f4e7d-336f-4c3e-b6ad-bb614849101d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.467739 Aug 19 09:21:45.358329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 367/782] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Aug 19 09:21:44 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:21:46.062514 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-17a7d799-aac4-45f5-80c5-f7db96571a77 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:46.063799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-17a7d799-aac4-45f5-80c5-f7db96571a77 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:46.071944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-17a7d799-aac4-45f5-80c5-f7db96571a77 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:46.072640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-17a7d799-aac4-45f5-80c5-f7db96571a77 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:46.073704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-17a7d799-aac4-45f5-80c5-f7db96571a77 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:46.074212 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-17a7d799-aac4-45f5-80c5-f7db96571a77 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:46.216862 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-17a7d799-aac4-45f5-80c5-f7db96571a77 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:46.229377 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-17a7d799-aac4-45f5-80c5-f7db96571a77 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1514 microversion: 2.1 time: 0.171082 Aug 19 09:21:46.230146 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 416/783] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:46 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:46.352771 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-71ea7165-65f1-45a2-aff8-9bbfdee7f560 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:46.355584 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-71ea7165-65f1-45a2-aff8-9bbfdee7f560 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:46.362512 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-71ea7165-65f1-45a2-aff8-9bbfdee7f560 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:46.362959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-71ea7165-65f1-45a2-aff8-9bbfdee7f560 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:46.363766 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-71ea7165-65f1-45a2-aff8-9bbfdee7f560 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:46.364195 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-71ea7165-65f1-45a2-aff8-9bbfdee7f560 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:46.524420 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-71ea7165-65f1-45a2-aff8-9bbfdee7f560 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 200 len: 38265 microversion: 2.20 time: 0.176524 Aug 19 09:21:46.529761 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 368/784] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:46 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 38265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:21:46.534727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fd58127d-93f1-48b6-828c-23c564c66117 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:46.535253 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fd58127d-93f1-48b6-828c-23c564c66117 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:46.541519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd58127d-93f1-48b6-828c-23c564c66117 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:46.542303 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd58127d-93f1-48b6-828c-23c564c66117 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:46.543094 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd58127d-93f1-48b6-828c-23c564c66117 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:46.543773 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fd58127d-93f1-48b6-828c-23c564c66117 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:46.566872 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fd58127d-93f1-48b6-828c-23c564c66117 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/ips" status: 200 len: 153 microversion: 2.20 time: 0.035741 Aug 19 09:21:46.568045 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 417/785] 10.222.0.32 () {60 vars in 1289 bytes} [Thu Aug 19 09:21:46 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:21:46.818552 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1392476934", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af454d54-e9ac-4c38-8d56-87a8a6413746"}], "security_groups": [{"name": "tempest-securitygroup--253601597"}], "key_name": "tempest-keypair-1175985524", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:47.001170 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] validate_networks() for [('af454d54-e9ac-4c38-8d56-87a8a6413746', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:21:47.248388 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6a557f1b-eddb-4f5e-b4dd-2ffbec2aac9b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:47.248992 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6a557f1b-eddb-4f5e-b4dd-2ffbec2aac9b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:47.255713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a557f1b-eddb-4f5e-b4dd-2ffbec2aac9b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:47.256161 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a557f1b-eddb-4f5e-b4dd-2ffbec2aac9b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:47.257121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a557f1b-eddb-4f5e-b4dd-2ffbec2aac9b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:47.257557 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a557f1b-eddb-4f5e-b4dd-2ffbec2aac9b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:47.416273 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6a557f1b-eddb-4f5e-b4dd-2ffbec2aac9b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:47.428354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6a557f1b-eddb-4f5e-b4dd-2ffbec2aac9b tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1514 microversion: 2.1 time: 0.184271 Aug 19 09:21:47.439232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 418/786] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:47 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:47.648704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:21:47.651191 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:21:47.651846 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:21:47.652432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:21:47.652986 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:21:47.665794 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:47.666979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:47.668519 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:47.669270 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:47.672115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-e9dab1e9-fff0-4147-bf5f-05f50b9e3965 req-0bd48934-e931-483b-888b-9245de79760d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b887e5c3-ec85-4ff3-8685-f04ce319ec60", "name": "network-vif-deleted", "tag": "c1bc4d32-4ce7-4c3a-9498-e98bcf48bd8d"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:47.673676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:47.673676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:21:47.681786 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-e9dab1e9-fff0-4147-bf5f-05f50b9e3965 req-0bd48934-e931-483b-888b-9245de79760d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:47.682483 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-e9dab1e9-fff0-4147-bf5f-05f50b9e3965 req-0bd48934-e931-483b-888b-9245de79760d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:47.696099 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-e9dab1e9-fff0-4147-bf5f-05f50b9e3965 req-0bd48934-e931-483b-888b-9245de79760d service nova] Creating event network-vif-deleted:c1bc4d32-4ce7-4c3a-9498-e98bcf48bd8d for instance b887e5c3-ec85-4ff3-8685-f04ce319ec60 on hv-cinder-77387 Aug 19 09:21:47.701324 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for project d19c107f773440eb8c2ab26706bc3591. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:21:47.701517 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-e9dab1e9-fff0-4147-bf5f-05f50b9e3965 req-0bd48934-e931-483b-888b-9245de79760d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033035 Aug 19 09:21:47.702007 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 419/787] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:21:47.709829 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for user 4775744e6880427c8e91e67afe713052 and project d19c107f773440eb8c2ab26706bc3591. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:21:47.723414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:21:47.727205 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:21:47.813219 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b233cf8d-3c88-4170-8f7e-f21b03cc8e80 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.004942 Aug 19 09:21:47.818199 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 369/788] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:21:46 2021] POST /compute/v2.1/servers => generated 401 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:21:47.830397 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-82d06903-c782-4b55-868c-28aa7753f3de tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:47.831258 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-82d06903-c782-4b55-868c-28aa7753f3de tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:47.914884 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-82d06903-c782-4b55-868c-28aa7753f3de tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:47.926232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-82d06903-c782-4b55-868c-28aa7753f3de tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1238 microversion: 2.1 time: 0.100548 Aug 19 09:21:47.936648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 420/789] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:47 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1238 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:48.450311 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:48.452124 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:48.460052 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:48.460801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:48.461984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:48.462623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:48.503827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:48.504572 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:48.505148 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lazy-loading 'fault' on Instance uuid b887e5c3-ec85-4ff3-8685-f04ce319ec60 {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:21:48.553859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:48.566709 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a29ca0c5-d56d-4e6b-9241-c22f69d320d9 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 200 len: 1308 microversion: 2.1 time: 0.124831 Aug 19 09:21:48.567254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 370/790] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:48 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:48.945097 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-794556b7-2957-40a4-99db-8b9f9a956282 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:48.946543 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-794556b7-2957-40a4-99db-8b9f9a956282 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:48.952676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-794556b7-2957-40a4-99db-8b9f9a956282 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:48.953128 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-794556b7-2957-40a4-99db-8b9f9a956282 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:48.953918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-794556b7-2957-40a4-99db-8b9f9a956282 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:48.954347 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-794556b7-2957-40a4-99db-8b9f9a956282 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:49.028446 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-794556b7-2957-40a4-99db-8b9f9a956282 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:49.036253 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-794556b7-2957-40a4-99db-8b9f9a956282 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1290 microversion: 2.1 time: 0.096021 Aug 19 09:21:49.037425 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 421/791] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:48 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:49.073632 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6cf11087-d4f2-4d2c-94fb-53e215b0137f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:49.074234 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6cf11087-d4f2-4d2c-94fb-53e215b0137f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:49.080517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6cf11087-d4f2-4d2c-94fb-53e215b0137f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:49.080962 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6cf11087-d4f2-4d2c-94fb-53e215b0137f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:49.081741 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6cf11087-d4f2-4d2c-94fb-53e215b0137f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:49.082353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6cf11087-d4f2-4d2c-94fb-53e215b0137f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:49.107672 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-6cf11087-d4f2-4d2c-94fb-53e215b0137f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lazy-loading 'flavor' on Instance uuid 7ed06d0a-7ee6-4f00-b470-b19d7331667c {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:21:49.455011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6cf11087-d4f2-4d2c-94fb-53e215b0137f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 202 len: 0 microversion: 2.20 time: 0.385037 Aug 19 09:21:49.456671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 371/792] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:21:49 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 19 09:21:49.463879 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-481ce5c4-4a07-497f-8e68-e35a9a1a818e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:49.464493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-481ce5c4-4a07-497f-8e68-e35a9a1a818e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:49.470625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-481ce5c4-4a07-497f-8e68-e35a9a1a818e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:49.471292 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-481ce5c4-4a07-497f-8e68-e35a9a1a818e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:49.472240 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-481ce5c4-4a07-497f-8e68-e35a9a1a818e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:49.472975 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-481ce5c4-4a07-497f-8e68-e35a9a1a818e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:49.589830 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-60654633-43a9-4c20-ad18-5e5745720374 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:49.591392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-60654633-43a9-4c20-ad18-5e5745720374 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: b887e5c3-ec85-4ff3-8685-f04ce319ec60] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:49.601834 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-60654633-43a9-4c20-ad18-5e5745720374 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:49.602285 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-60654633-43a9-4c20-ad18-5e5745720374 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:49.603370 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-60654633-43a9-4c20-ad18-5e5745720374 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:49.603814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-60654633-43a9-4c20-ad18-5e5745720374 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:49.609739 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-481ce5c4-4a07-497f-8e68-e35a9a1a818e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:49.620532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-481ce5c4-4a07-497f-8e68-e35a9a1a818e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:49.622899 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-481ce5c4-4a07-497f-8e68-e35a9a1a818e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:49.624688 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-481ce5c4-4a07-497f-8e68-e35a9a1a818e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.164505 Aug 19 09:21:49.626027 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 422/793] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:21:49 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:21:49.626491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-60654633-43a9-4c20-ad18-5e5745720374 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] HTTP exception thrown: Instance b887e5c3-ec85-4ff3-8685-f04ce319ec60 could not be found. Aug 19 09:21:49.627186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-60654633-43a9-4c20-ad18-5e5745720374 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Returning 404 to user: Instance b887e5c3-ec85-4ff3-8685-f04ce319ec60 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:21:49.628177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-60654633-43a9-4c20-ad18-5e5745720374 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60" status: 404 len: 111 microversion: 2.1 time: 0.046819 Aug 19 09:21:49.629053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 372/794] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:49 2021] GET /compute/v2.1/servers/b887e5c3-ec85-4ff3-8685-f04ce319ec60 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:21:50.054614 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3975d56d-98bc-4aa2-80a9-d40287a735f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:50.056298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3975d56d-98bc-4aa2-80a9-d40287a735f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:50.064586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3975d56d-98bc-4aa2-80a9-d40287a735f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:50.065115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3975d56d-98bc-4aa2-80a9-d40287a735f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:50.065946 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3975d56d-98bc-4aa2-80a9-d40287a735f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:50.066377 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3975d56d-98bc-4aa2-80a9-d40287a735f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:50.189411 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3975d56d-98bc-4aa2-80a9-d40287a735f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:50.197062 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3975d56d-98bc-4aa2-80a9-d40287a735f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1363 microversion: 2.1 time: 0.146635 Aug 19 09:21:50.197629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 423/795] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:50 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:50.490436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-6c68ac37-a9be-4c26-8272-cd5177070c1e req-aef7d031-9ec0-4ea8-85ce-833121852255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424", "tag": "f2ce61e2-8fd3-4bf9-b651-e4a66eec2886"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:50.492629 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:50.492629 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:21:50.506805 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-6c68ac37-a9be-4c26-8272-cd5177070c1e req-aef7d031-9ec0-4ea8-85ce-833121852255 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:50.507173 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-6c68ac37-a9be-4c26-8272-cd5177070c1e req-aef7d031-9ec0-4ea8-85ce-833121852255 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:50.519634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-6c68ac37-a9be-4c26-8272-cd5177070c1e req-aef7d031-9ec0-4ea8-85ce-833121852255 service nova] Creating event network-changed:f2ce61e2-8fd3-4bf9-b651-e4a66eec2886 for instance 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 on hv-cinder-77387 Aug 19 09:21:50.525984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-6c68ac37-a9be-4c26-8272-cd5177070c1e req-aef7d031-9ec0-4ea8-85ce-833121852255 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046754 Aug 19 09:21:50.527146 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 373/796] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:50.644809 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d4c78da0-de24-4ce4-b083-30d3b3c1d539 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:50.647897 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d4c78da0-de24-4ce4-b083-30d3b3c1d539 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:50.652409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4c78da0-de24-4ce4-b083-30d3b3c1d539 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:50.652853 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4c78da0-de24-4ce4-b083-30d3b3c1d539 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:50.653657 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4c78da0-de24-4ce4-b083-30d3b3c1d539 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:50.654084 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d4c78da0-de24-4ce4-b083-30d3b3c1d539 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:50.783180 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d4c78da0-de24-4ce4-b083-30d3b3c1d539 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:50.786893 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0aca42bf-45f9-45a9-a605-4b670ace0ebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:50.787729 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0aca42bf-45f9-45a9-a605-4b670ace0ebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:50.791811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d4c78da0-de24-4ce4-b083-30d3b3c1d539 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:50.793408 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d4c78da0-de24-4ce4-b083-30d3b3c1d539 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:50.793671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0aca42bf-45f9-45a9-a605-4b670ace0ebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:50.794107 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0aca42bf-45f9-45a9-a605-4b670ace0ebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:50.794842 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d4c78da0-de24-4ce4-b083-30d3b3c1d539 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.153719 Aug 19 09:21:50.794941 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0aca42bf-45f9-45a9-a605-4b670ace0ebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:50.795328 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0aca42bf-45f9-45a9-a605-4b670ace0ebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:50.795698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 424/797] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:21:50 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:21:50.821428 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0aca42bf-45f9-45a9-a605-4b670ace0ebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:21:50.899662 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0aca42bf-45f9-45a9-a605-4b670ace0ebe tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "DELETE /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 204 len: 0 microversion: 2.1 time: 0.116825 Aug 19 09:21:50.903203 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 374/798] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:21:50 2021] DELETE /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 09:21:50.912276 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4eb92e15-aefe-495f-8201-bfbe02478c16 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:50.912885 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4eb92e15-aefe-495f-8201-bfbe02478c16 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:50.918522 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4eb92e15-aefe-495f-8201-bfbe02478c16 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:50.918966 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4eb92e15-aefe-495f-8201-bfbe02478c16 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:50.919875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4eb92e15-aefe-495f-8201-bfbe02478c16 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:50.920302 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4eb92e15-aefe-495f-8201-bfbe02478c16 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:51.044930 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4eb92e15-aefe-495f-8201-bfbe02478c16 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:51.052321 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4eb92e15-aefe-495f-8201-bfbe02478c16 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1513 microversion: 2.1 time: 0.147702 Aug 19 09:21:51.053833 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 425/799] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:50 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:51.214722 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-57e206db-8ebc-4461-8245-2da756108349 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:51.216044 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-57e206db-8ebc-4461-8245-2da756108349 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:51.221630 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-57e206db-8ebc-4461-8245-2da756108349 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:51.222062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-57e206db-8ebc-4461-8245-2da756108349 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:51.222814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-57e206db-8ebc-4461-8245-2da756108349 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:51.223238 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-57e206db-8ebc-4461-8245-2da756108349 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:51.615526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-57e206db-8ebc-4461-8245-2da756108349 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:51.622540 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-57e206db-8ebc-4461-8245-2da756108349 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1363 microversion: 2.1 time: 0.411787 Aug 19 09:21:51.623098 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 375/800] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:51 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:51.814127 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d30057d7-020d-4fe7-965a-b0cb8aab98ec tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:51.814726 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d30057d7-020d-4fe7-965a-b0cb8aab98ec tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:51.820466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d30057d7-020d-4fe7-965a-b0cb8aab98ec tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:51.820905 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d30057d7-020d-4fe7-965a-b0cb8aab98ec tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:51.821656 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d30057d7-020d-4fe7-965a-b0cb8aab98ec tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:51.822081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d30057d7-020d-4fe7-965a-b0cb8aab98ec tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:51.949579 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d30057d7-020d-4fe7-965a-b0cb8aab98ec tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:51.957110 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d30057d7-020d-4fe7-965a-b0cb8aab98ec tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:51.958732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d30057d7-020d-4fe7-965a-b0cb8aab98ec tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:51.959884 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d30057d7-020d-4fe7-965a-b0cb8aab98ec tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.149872 Aug 19 09:21:51.960440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 426/801] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:21:51 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:21:52.069821 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-655b9a2d-327f-4177-bfa3-0c34fd0cd6b4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:52.070430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-655b9a2d-327f-4177-bfa3-0c34fd0cd6b4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:52.076198 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-655b9a2d-327f-4177-bfa3-0c34fd0cd6b4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:52.076639 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-655b9a2d-327f-4177-bfa3-0c34fd0cd6b4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:52.077385 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-655b9a2d-327f-4177-bfa3-0c34fd0cd6b4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:52.077811 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-655b9a2d-327f-4177-bfa3-0c34fd0cd6b4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:52.194041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-655b9a2d-327f-4177-bfa3-0c34fd0cd6b4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:52.201451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-655b9a2d-327f-4177-bfa3-0c34fd0cd6b4 tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1513 microversion: 2.1 time: 0.135319 Aug 19 09:21:52.202000 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 376/802] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:52 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1513 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:52.639579 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-03852c5a-07cf-435b-b91d-819a1dc447f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:52.640208 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-03852c5a-07cf-435b-b91d-819a1dc447f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:52.646598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03852c5a-07cf-435b-b91d-819a1dc447f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:52.647037 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03852c5a-07cf-435b-b91d-819a1dc447f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:52.647819 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03852c5a-07cf-435b-b91d-819a1dc447f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:52.648252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-03852c5a-07cf-435b-b91d-819a1dc447f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:52.769299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-03852c5a-07cf-435b-b91d-819a1dc447f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:52.777146 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-03852c5a-07cf-435b-b91d-819a1dc447f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1363 microversion: 2.1 time: 0.141231 Aug 19 09:21:52.777702 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 427/803] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:52 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:52.978092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-78e3b4a3-f6c3-4eb3-83e0-50363eb40aaf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:52.978609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-78e3b4a3-f6c3-4eb3-83e0-50363eb40aaf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:52.984348 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78e3b4a3-f6c3-4eb3-83e0-50363eb40aaf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:52.984792 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78e3b4a3-f6c3-4eb3-83e0-50363eb40aaf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:52.985546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78e3b4a3-f6c3-4eb3-83e0-50363eb40aaf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:52.985980 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78e3b4a3-f6c3-4eb3-83e0-50363eb40aaf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:53.103961 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-78e3b4a3-f6c3-4eb3-83e0-50363eb40aaf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:53.111653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-78e3b4a3-f6c3-4eb3-83e0-50363eb40aaf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:53.113152 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-78e3b4a3-f6c3-4eb3-83e0-50363eb40aaf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:53.114304 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-78e3b4a3-f6c3-4eb3-83e0-50363eb40aaf tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.140739 Aug 19 09:21:53.114858 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 377/804] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:21:52 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:21:53.217610 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6cd9c550-d1f6-4b88-9008-6de4979885ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:53.218235 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6cd9c550-d1f6-4b88-9008-6de4979885ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:53.224642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cd9c550-d1f6-4b88-9008-6de4979885ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:53.225090 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cd9c550-d1f6-4b88-9008-6de4979885ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:53.225848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cd9c550-d1f6-4b88-9008-6de4979885ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:53.226282 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6cd9c550-d1f6-4b88-9008-6de4979885ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:53.346212 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6cd9c550-d1f6-4b88-9008-6de4979885ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:53.354637 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6cd9c550-d1f6-4b88-9008-6de4979885ef tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1513 microversion: 2.1 time: 0.140638 Aug 19 09:21:53.355323 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 428/805] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:53 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:53.770028 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-43d90839-1ae1-4296-b8c6-29fbe64f7c5e req-f44dec69-55b4-4311-8c41-32109f3c3df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728c5e2b-27f2-4879-b35b-7b814e6dca52", "name": "network-vif-deleted", "tag": "d13f978a-34d4-4492-ad11-9cefbdb91dcc"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:53.772138 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:53.772138 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:21:53.780369 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-43d90839-1ae1-4296-b8c6-29fbe64f7c5e req-f44dec69-55b4-4311-8c41-32109f3c3df3 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:53.781150 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-43d90839-1ae1-4296-b8c6-29fbe64f7c5e req-f44dec69-55b4-4311-8c41-32109f3c3df3 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:53.792689 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-43d90839-1ae1-4296-b8c6-29fbe64f7c5e req-f44dec69-55b4-4311-8c41-32109f3c3df3 service nova] Creating event network-vif-deleted:d13f978a-34d4-4492-ad11-9cefbdb91dcc for instance 728c5e2b-27f2-4879-b35b-7b814e6dca52 on hv-cinder-77387 Aug 19 09:21:53.793583 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8082d5f1-a0a7-4448-b3bb-460ec0b9fc6c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:53.794151 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8082d5f1-a0a7-4448-b3bb-460ec0b9fc6c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:53.797476 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-43d90839-1ae1-4296-b8c6-29fbe64f7c5e req-f44dec69-55b4-4311-8c41-32109f3c3df3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032174 Aug 19 09:21:53.798248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 378/806] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:53.800966 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8082d5f1-a0a7-4448-b3bb-460ec0b9fc6c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:53.801407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8082d5f1-a0a7-4448-b3bb-460ec0b9fc6c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:53.802725 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8082d5f1-a0a7-4448-b3bb-460ec0b9fc6c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:53.803145 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8082d5f1-a0a7-4448-b3bb-460ec0b9fc6c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:53.925910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8082d5f1-a0a7-4448-b3bb-460ec0b9fc6c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:53.933887 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8082d5f1-a0a7-4448-b3bb-460ec0b9fc6c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1363 microversion: 2.1 time: 0.144234 Aug 19 09:21:53.934455 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 429/807] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:53 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:54.132715 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a980b9ab-05c4-4c7f-94a7-c3ff935a20b8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:54.133431 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a980b9ab-05c4-4c7f-94a7-c3ff935a20b8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:54.139620 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a980b9ab-05c4-4c7f-94a7-c3ff935a20b8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:54.140020 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a980b9ab-05c4-4c7f-94a7-c3ff935a20b8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:54.140788 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a980b9ab-05c4-4c7f-94a7-c3ff935a20b8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:54.141226 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a980b9ab-05c4-4c7f-94a7-c3ff935a20b8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:54.260214 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a980b9ab-05c4-4c7f-94a7-c3ff935a20b8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:54.267752 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a980b9ab-05c4-4c7f-94a7-c3ff935a20b8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:54.269243 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a980b9ab-05c4-4c7f-94a7-c3ff935a20b8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:54.270497 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a980b9ab-05c4-4c7f-94a7-c3ff935a20b8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.141685 Aug 19 09:21:54.271262 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 379/808] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:21:54 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:21:54.370952 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:54.371586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:54.377370 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:54.377994 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:54.378940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:54.379410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:54.414293 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:54.414747 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:54.415225 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lazy-loading 'fault' on Instance uuid 728c5e2b-27f2-4879-b35b-7b814e6dca52 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:21:54.459894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa387ffa6784561956f39df611dfab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd62739089241319075c92d0306a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:54.467792 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-140cede1-77e9-4b84-a0f0-be520007d97f tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 200 len: 1307 microversion: 2.1 time: 0.100282 Aug 19 09:21:54.468756 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 430/809] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:54 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:54.952113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-62129800-5e47-4a98-8270-9596bfcf2346 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:54.952731 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-62129800-5e47-4a98-8270-9596bfcf2346 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:54.959802 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62129800-5e47-4a98-8270-9596bfcf2346 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:54.960259 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62129800-5e47-4a98-8270-9596bfcf2346 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:54.961026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62129800-5e47-4a98-8270-9596bfcf2346 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:54.961464 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-62129800-5e47-4a98-8270-9596bfcf2346 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:55.083898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-62129800-5e47-4a98-8270-9596bfcf2346 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:55.091264 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-62129800-5e47-4a98-8270-9596bfcf2346 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1363 microversion: 2.1 time: 0.142757 Aug 19 09:21:55.091896 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 380/810] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:54 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:55.288876 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-39770b28-17e1-422d-9665-4ac33889eec9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:55.289477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-39770b28-17e1-422d-9665-4ac33889eec9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:55.295263 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-39770b28-17e1-422d-9665-4ac33889eec9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:55.295731 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-39770b28-17e1-422d-9665-4ac33889eec9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:55.296476 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-39770b28-17e1-422d-9665-4ac33889eec9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:55.296898 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-39770b28-17e1-422d-9665-4ac33889eec9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:55.418019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-39770b28-17e1-422d-9665-4ac33889eec9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:55.425641 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-39770b28-17e1-422d-9665-4ac33889eec9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:55.427897 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-39770b28-17e1-422d-9665-4ac33889eec9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:55.429034 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-39770b28-17e1-422d-9665-4ac33889eec9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.143941 Aug 19 09:21:55.429579 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 431/811] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:21:55 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:21:55.485338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2acf07b8-2138-43ec-9ebc-5d6ac222d1ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:55.485959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2acf07b8-2138-43ec-9ebc-5d6ac222d1ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] [instance: 728c5e2b-27f2-4879-b35b-7b814e6dca52] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:55.492341 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2acf07b8-2138-43ec-9ebc-5d6ac222d1ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:55.492792 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2acf07b8-2138-43ec-9ebc-5d6ac222d1ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:55.493567 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2acf07b8-2138-43ec-9ebc-5d6ac222d1ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:55.494003 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2acf07b8-2138-43ec-9ebc-5d6ac222d1ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:55.507374 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-2acf07b8-2138-43ec-9ebc-5d6ac222d1ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] HTTP exception thrown: Instance 728c5e2b-27f2-4879-b35b-7b814e6dca52 could not be found. Aug 19 09:21:55.507966 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2acf07b8-2138-43ec-9ebc-5d6ac222d1ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] Returning 404 to user: Instance 728c5e2b-27f2-4879-b35b-7b814e6dca52 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:21:55.508786 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2acf07b8-2138-43ec-9ebc-5d6ac222d1ed tempest-AttachVolumeNegativeTest-2071637082 tempest-AttachVolumeNegativeTest-2071637082-project] 10.222.0.32 "GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52" status: 404 len: 111 microversion: 2.1 time: 0.027185 Aug 19 09:21:55.509399 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 381/812] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:55 2021] GET /compute/v2.1/servers/728c5e2b-27f2-4879-b35b-7b814e6dca52 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:21:56.108237 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8c08e85c-5e34-4bba-b96c-776c5902c9fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:56.108849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8c08e85c-5e34-4bba-b96c-776c5902c9fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:56.115466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c08e85c-5e34-4bba-b96c-776c5902c9fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:56.115669 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c08e85c-5e34-4bba-b96c-776c5902c9fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:56.116423 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c08e85c-5e34-4bba-b96c-776c5902c9fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:56.116848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c08e85c-5e34-4bba-b96c-776c5902c9fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:56.235923 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8c08e85c-5e34-4bba-b96c-776c5902c9fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:56.244076 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8c08e85c-5e34-4bba-b96c-776c5902c9fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1363 microversion: 2.1 time: 0.139432 Aug 19 09:21:56.244742 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 432/813] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:56 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:56.446614 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3cc82faa-225d-4e18-a41d-9885a586a5d3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:56.447321 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3cc82faa-225d-4e18-a41d-9885a586a5d3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:56.453121 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cc82faa-225d-4e18-a41d-9885a586a5d3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:56.453633 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cc82faa-225d-4e18-a41d-9885a586a5d3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:56.454390 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cc82faa-225d-4e18-a41d-9885a586a5d3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:56.454815 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cc82faa-225d-4e18-a41d-9885a586a5d3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:56.584720 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3cc82faa-225d-4e18-a41d-9885a586a5d3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:56.592854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3cc82faa-225d-4e18-a41d-9885a586a5d3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:56.594359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3cc82faa-225d-4e18-a41d-9885a586a5d3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:56.595512 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3cc82faa-225d-4e18-a41d-9885a586a5d3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.152371 Aug 19 09:21:56.596174 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 382/814] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:21:56 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:21:57.168241 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-209319a6-fd62-4587-a184-55dc9dc64d4b req-39599c29-f922-465d-ae55-1368c9957587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424", "name": "network-vif-plugged", "status": "completed", "tag": "f2ce61e2-8fd3-4bf9-b651-e4a66eec2886"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:21:57.169830 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:21:57.169830 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:21:57.177906 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-209319a6-fd62-4587-a184-55dc9dc64d4b req-39599c29-f922-465d-ae55-1368c9957587 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:57.178341 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-209319a6-fd62-4587-a184-55dc9dc64d4b req-39599c29-f922-465d-ae55-1368c9957587 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:57.189646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-209319a6-fd62-4587-a184-55dc9dc64d4b req-39599c29-f922-465d-ae55-1368c9957587 service nova] Creating event network-vif-plugged:f2ce61e2-8fd3-4bf9-b651-e4a66eec2886 for instance 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 on hv-cinder-77387 Aug 19 09:21:57.195446 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-209319a6-fd62-4587-a184-55dc9dc64d4b req-39599c29-f922-465d-ae55-1368c9957587 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034392 Aug 19 09:21:57.196175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 433/815] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:21:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:57.261415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-baf2e969-2f10-4631-8d58-abd098c4a38b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:57.262029 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-baf2e969-2f10-4631-8d58-abd098c4a38b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:57.267726 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-baf2e969-2f10-4631-8d58-abd098c4a38b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:57.268407 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-baf2e969-2f10-4631-8d58-abd098c4a38b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:57.269327 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-baf2e969-2f10-4631-8d58-abd098c4a38b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:57.269751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-baf2e969-2f10-4631-8d58-abd098c4a38b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:57.420312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-baf2e969-2f10-4631-8d58-abd098c4a38b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:57.428464 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-baf2e969-2f10-4631-8d58-abd098c4a38b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1363 microversion: 2.1 time: 0.170666 Aug 19 09:21:57.429023 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 383/816] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:57 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:57.615780 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f4dfbdb4-2435-41c8-afe1-c6ecb24ae1ad tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:57.616581 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f4dfbdb4-2435-41c8-afe1-c6ecb24ae1ad tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:57.622926 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f4dfbdb4-2435-41c8-afe1-c6ecb24ae1ad tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:57.623525 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f4dfbdb4-2435-41c8-afe1-c6ecb24ae1ad tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:57.624369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f4dfbdb4-2435-41c8-afe1-c6ecb24ae1ad tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:57.624809 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f4dfbdb4-2435-41c8-afe1-c6ecb24ae1ad tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:57.745801 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f4dfbdb4-2435-41c8-afe1-c6ecb24ae1ad tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:57.753902 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f4dfbdb4-2435-41c8-afe1-c6ecb24ae1ad tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:57.756211 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f4dfbdb4-2435-41c8-afe1-c6ecb24ae1ad tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:57.757354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f4dfbdb4-2435-41c8-afe1-c6ecb24ae1ad tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.146342 Aug 19 09:21:57.758016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 434/817] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:21:57 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:21:58.445485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bef699eb-188f-4fc5-8507-0fd65c75fd63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:58.446092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bef699eb-188f-4fc5-8507-0fd65c75fd63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:58.451907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bef699eb-188f-4fc5-8507-0fd65c75fd63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:58.452344 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bef699eb-188f-4fc5-8507-0fd65c75fd63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:58.453093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bef699eb-188f-4fc5-8507-0fd65c75fd63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:58.453516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bef699eb-188f-4fc5-8507-0fd65c75fd63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:58.573816 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bef699eb-188f-4fc5-8507-0fd65c75fd63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:58.580983 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bef699eb-188f-4fc5-8507-0fd65c75fd63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1363 microversion: 2.1 time: 0.139770 Aug 19 09:21:58.581550 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 384/818] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:58 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:58.775830 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6f647614-96bd-4ef9-b90f-25b7193b28e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:58.776432 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6f647614-96bd-4ef9-b90f-25b7193b28e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:58.782215 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f647614-96bd-4ef9-b90f-25b7193b28e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:58.782659 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f647614-96bd-4ef9-b90f-25b7193b28e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:58.783443 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f647614-96bd-4ef9-b90f-25b7193b28e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:58.783874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f647614-96bd-4ef9-b90f-25b7193b28e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:58.908725 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6f647614-96bd-4ef9-b90f-25b7193b28e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:58.917560 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6f647614-96bd-4ef9-b90f-25b7193b28e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:58.919052 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6f647614-96bd-4ef9-b90f-25b7193b28e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:58.920214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6f647614-96bd-4ef9-b90f-25b7193b28e2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.148060 Aug 19 09:21:58.920765 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 435/819] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:21:58 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:21:59.600255 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-aba1d62a-c77f-43b8-b1e1-a8bd1afa5420 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:59.601028 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-aba1d62a-c77f-43b8-b1e1-a8bd1afa5420 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:59.607144 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aba1d62a-c77f-43b8-b1e1-a8bd1afa5420 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:59.607622 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aba1d62a-c77f-43b8-b1e1-a8bd1afa5420 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:59.608391 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aba1d62a-c77f-43b8-b1e1-a8bd1afa5420 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:59.608825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aba1d62a-c77f-43b8-b1e1-a8bd1afa5420 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:59.740011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-aba1d62a-c77f-43b8-b1e1-a8bd1afa5420 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:21:59.747377 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-aba1d62a-c77f-43b8-b1e1-a8bd1afa5420 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1549 microversion: 2.1 time: 0.151281 Aug 19 09:21:59.747933 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 385/820] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:21:59 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:21:59.763953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7447884d-5835-4f42-a353-431c6805b78e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:59.764439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7447884d-5835-4f42-a353-431c6805b78e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:59.770315 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7447884d-5835-4f42-a353-431c6805b78e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:59.770959 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7447884d-5835-4f42-a353-431c6805b78e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:59.771747 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7447884d-5835-4f42-a353-431c6805b78e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:59.772177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7447884d-5835-4f42-a353-431c6805b78e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:59.850256 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7447884d-5835-4f42-a353-431c6805b78e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089913 Aug 19 09:21:59.850888 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 436/821] 10.222.0.32 () {58 vars in 1275 bytes} [Thu Aug 19 09:21:59 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:21:59.940087 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-24e52857-adbd-4237-bf4c-e7e4c7b63c64 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:21:59.940693 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-24e52857-adbd-4237-bf4c-e7e4c7b63c64 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:21:59.947099 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24e52857-adbd-4237-bf4c-e7e4c7b63c64 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:59.947574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24e52857-adbd-4237-bf4c-e7e4c7b63c64 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:21:59.948337 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24e52857-adbd-4237-bf4c-e7e4c7b63c64 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:21:59.948770 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24e52857-adbd-4237-bf4c-e7e4c7b63c64 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:00.073593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-24e52857-adbd-4237-bf4c-e7e4c7b63c64 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:00.081310 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-24e52857-adbd-4237-bf4c-e7e4c7b63c64 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:00.082852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-24e52857-adbd-4237-bf4c-e7e4c7b63c64 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:00.084085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-24e52857-adbd-4237-bf4c-e7e4c7b63c64 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.147693 Aug 19 09:22:00.084638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 386/822] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:21:59 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:01.021479 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-a815491a-a94e-400c-89d2-ca0101484598 req-8e6a3f0c-3941-4189-b55d-dc64462dffaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424", "tag": "f2ce61e2-8fd3-4bf9-b651-e4a66eec2886"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:01.023727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-038a85a1-f7ad-4458-83e0-b53c852f4b5b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:01.024746 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-038a85a1-f7ad-4458-83e0-b53c852f4b5b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:01.025338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:22:01.025338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:22:01.031240 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-038a85a1-f7ad-4458-83e0-b53c852f4b5b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:01.032324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-038a85a1-f7ad-4458-83e0-b53c852f4b5b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:01.033273 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-038a85a1-f7ad-4458-83e0-b53c852f4b5b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:01.033415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-a815491a-a94e-400c-89d2-ca0101484598 req-8e6a3f0c-3941-4189-b55d-dc64462dffaa service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:01.033825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-a815491a-a94e-400c-89d2-ca0101484598 req-8e6a3f0c-3941-4189-b55d-dc64462dffaa service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:01.034310 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-038a85a1-f7ad-4458-83e0-b53c852f4b5b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:01.046260 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-a815491a-a94e-400c-89d2-ca0101484598 req-8e6a3f0c-3941-4189-b55d-dc64462dffaa service nova] Creating event network-changed:f2ce61e2-8fd3-4bf9-b651-e4a66eec2886 for instance 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 on hv-cinder-77387 Aug 19 09:22:01.051239 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-a815491a-a94e-400c-89d2-ca0101484598 req-8e6a3f0c-3941-4189-b55d-dc64462dffaa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033267 Aug 19 09:22:01.053060 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 387/823] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:22:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:22:01.103468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-217a3385-8483-4b37-a4ea-7ff3c4191ff0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:01.104162 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-217a3385-8483-4b37-a4ea-7ff3c4191ff0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:01.110881 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-217a3385-8483-4b37-a4ea-7ff3c4191ff0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:01.111359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-217a3385-8483-4b37-a4ea-7ff3c4191ff0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:01.112119 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-217a3385-8483-4b37-a4ea-7ff3c4191ff0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:01.112545 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-217a3385-8483-4b37-a4ea-7ff3c4191ff0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:01.144469 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-038a85a1-f7ad-4458-83e0-b53c852f4b5b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 14 microversion: 2.1 time: 0.129760 Aug 19 09:22:01.149275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 437/824] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:01 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:22:01.292892 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-217a3385-8483-4b37-a4ea-7ff3c4191ff0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:01.300551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-217a3385-8483-4b37-a4ea-7ff3c4191ff0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:01.302355 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-217a3385-8483-4b37-a4ea-7ff3c4191ff0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:01.303541 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-217a3385-8483-4b37-a4ea-7ff3c4191ff0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.204149 Aug 19 09:22:01.304088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 388/825] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:01 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:01.858062 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-62c34dc7-b3c4-4ebc-9eb5-63b04515f6b3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b6a88ed-66fd-4352-821d-6c3dc2d2d94d", "device": "/dev/sdb"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:01.859724 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-62c34dc7-b3c4-4ebc-9eb5-63b04515f6b3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:01.866622 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-62c34dc7-b3c4-4ebc-9eb5-63b04515f6b3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:01.867065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-62c34dc7-b3c4-4ebc-9eb5-63b04515f6b3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:01.867854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-62c34dc7-b3c4-4ebc-9eb5-63b04515f6b3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:01.868284 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-62c34dc7-b3c4-4ebc-9eb5-63b04515f6b3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:02.156551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8684c971-6702-4258-bb8d-0ebdd0585032 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:02.157480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8684c971-6702-4258-bb8d-0ebdd0585032 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:02.163785 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8684c971-6702-4258-bb8d-0ebdd0585032 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:02.164228 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8684c971-6702-4258-bb8d-0ebdd0585032 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:02.164984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8684c971-6702-4258-bb8d-0ebdd0585032 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:02.165408 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8684c971-6702-4258-bb8d-0ebdd0585032 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:02.437546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8684c971-6702-4258-bb8d-0ebdd0585032 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 14 microversion: 2.1 time: 0.284421 Aug 19 09:22:02.438179 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 389/826] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:02 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 14 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 19 09:22:02.444106 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-08aea43d-dadb-4857-8d2a-d019a03d6f23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:02.444910 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-08aea43d-dadb-4857-8d2a-d019a03d6f23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:02.451642 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08aea43d-dadb-4857-8d2a-d019a03d6f23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:02.452099 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08aea43d-dadb-4857-8d2a-d019a03d6f23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:02.452879 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08aea43d-dadb-4857-8d2a-d019a03d6f23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:02.453343 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08aea43d-dadb-4857-8d2a-d019a03d6f23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:02.557396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-62c34dc7-b3c4-4ebc-9eb5-63b04515f6b3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "POST /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703085 Aug 19 09:22:02.558307 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 438/827] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:22:01 2021] POST /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:22:02.586769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-08aea43d-dadb-4857-8d2a-d019a03d6f23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:02.594726 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-08aea43d-dadb-4857-8d2a-d019a03d6f23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:02.596243 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-08aea43d-dadb-4857-8d2a-d019a03d6f23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:02.597433 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-08aea43d-dadb-4857-8d2a-d019a03d6f23 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.158169 Aug 19 09:22:02.598101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 390/828] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:02 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:03.448083 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d229756d-e5e7-4e22-bd98-a4147134df92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:03.449119 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d229756d-e5e7-4e22-bd98-a4147134df92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:03.456328 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d229756d-e5e7-4e22-bd98-a4147134df92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:03.456765 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d229756d-e5e7-4e22-bd98-a4147134df92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:03.458074 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d229756d-e5e7-4e22-bd98-a4147134df92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:03.458557 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d229756d-e5e7-4e22-bd98-a4147134df92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:03.615748 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-968247a9-4fdb-4f8c-81be-b0a3c99d8c61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:03.616380 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-968247a9-4fdb-4f8c-81be-b0a3c99d8c61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:03.622520 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-968247a9-4fdb-4f8c-81be-b0a3c99d8c61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:03.622959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-968247a9-4fdb-4f8c-81be-b0a3c99d8c61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:03.623743 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-968247a9-4fdb-4f8c-81be-b0a3c99d8c61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:03.624169 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-968247a9-4fdb-4f8c-81be-b0a3c99d8c61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:03.748329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-968247a9-4fdb-4f8c-81be-b0a3c99d8c61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:03.756344 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-968247a9-4fdb-4f8c-81be-b0a3c99d8c61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:03.757827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-968247a9-4fdb-4f8c-81be-b0a3c99d8c61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:03.758949 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-968247a9-4fdb-4f8c-81be-b0a3c99d8c61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.147221 Aug 19 09:22:03.759537 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 391/829] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:03 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:04.776645 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-22693d4e-ba26-471b-ad5d-c674dfa95481 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:04.777248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-22693d4e-ba26-471b-ad5d-c674dfa95481 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:04.782923 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22693d4e-ba26-471b-ad5d-c674dfa95481 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:04.783394 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22693d4e-ba26-471b-ad5d-c674dfa95481 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:04.784145 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22693d4e-ba26-471b-ad5d-c674dfa95481 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:04.784569 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22693d4e-ba26-471b-ad5d-c674dfa95481 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:04.902358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-22693d4e-ba26-471b-ad5d-c674dfa95481 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:04.909859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-22693d4e-ba26-471b-ad5d-c674dfa95481 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:04.912167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-22693d4e-ba26-471b-ad5d-c674dfa95481 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:04.913291 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-22693d4e-ba26-471b-ad5d-c674dfa95481 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.140282 Aug 19 09:22:04.913852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 392/830] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:04 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:05.931789 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0f61c1a1-e995-42c3-9fa9-cea2073c2fbc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:05.932403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0f61c1a1-e995-42c3-9fa9-cea2073c2fbc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:05.938491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0f61c1a1-e995-42c3-9fa9-cea2073c2fbc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:05.938877 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0f61c1a1-e995-42c3-9fa9-cea2073c2fbc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:05.939653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0f61c1a1-e995-42c3-9fa9-cea2073c2fbc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:05.940083 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0f61c1a1-e995-42c3-9fa9-cea2073c2fbc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:06.059755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0f61c1a1-e995-42c3-9fa9-cea2073c2fbc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:06.067449 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0f61c1a1-e995-42c3-9fa9-cea2073c2fbc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:06.068973 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0f61c1a1-e995-42c3-9fa9-cea2073c2fbc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:06.070104 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0f61c1a1-e995-42c3-9fa9-cea2073c2fbc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.142150 Aug 19 09:22:06.070650 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 393/831] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:05 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:06.099097 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d229756d-e5e7-4e22-bd98-a4147134df92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 14 microversion: 2.1 time: 2.654119 Aug 19 09:22:06.099934 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 439/832] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:03 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 14 bytes in 2657 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:22:07.088928 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7ea5134d-dbc5-4ed8-be31-518e1900d784 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:07.089536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7ea5134d-dbc5-4ed8-be31-518e1900d784 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:07.095205 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7ea5134d-dbc5-4ed8-be31-518e1900d784 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:07.095744 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7ea5134d-dbc5-4ed8-be31-518e1900d784 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:07.096458 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7ea5134d-dbc5-4ed8-be31-518e1900d784 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:07.096895 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7ea5134d-dbc5-4ed8-be31-518e1900d784 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:07.110767 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-799af712-3327-4b6f-910f-fe803cf46438 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:07.112520 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-799af712-3327-4b6f-910f-fe803cf46438 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:07.119223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-799af712-3327-4b6f-910f-fe803cf46438 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:07.119879 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-799af712-3327-4b6f-910f-fe803cf46438 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:07.120754 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-799af712-3327-4b6f-910f-fe803cf46438 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:07.121365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-799af712-3327-4b6f-910f-fe803cf46438 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:07.233850 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7ea5134d-dbc5-4ed8-be31-518e1900d784 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:07.241866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7ea5134d-dbc5-4ed8-be31-518e1900d784 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:07.243392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7ea5134d-dbc5-4ed8-be31-518e1900d784 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:07.244540 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7ea5134d-dbc5-4ed8-be31-518e1900d784 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.159271 Aug 19 09:22:07.245100 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 394/833] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:07 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:07.892335 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-799af712-3327-4b6f-910f-fe803cf46438 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 14 microversion: 2.1 time: 0.785295 Aug 19 09:22:07.894289 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 440/834] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:07 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 14 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:22:08.262783 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-73759ea2-a5cb-4bd5-a4fa-3e1e2cce016b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:08.263421 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-73759ea2-a5cb-4bd5-a4fa-3e1e2cce016b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:08.269153 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73759ea2-a5cb-4bd5-a4fa-3e1e2cce016b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:08.269599 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73759ea2-a5cb-4bd5-a4fa-3e1e2cce016b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:08.270455 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73759ea2-a5cb-4bd5-a4fa-3e1e2cce016b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:08.270884 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73759ea2-a5cb-4bd5-a4fa-3e1e2cce016b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:08.389938 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-73759ea2-a5cb-4bd5-a4fa-3e1e2cce016b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:08.397528 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-73759ea2-a5cb-4bd5-a4fa-3e1e2cce016b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:08.398983 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-73759ea2-a5cb-4bd5-a4fa-3e1e2cce016b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:08.400130 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-73759ea2-a5cb-4bd5-a4fa-3e1e2cce016b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1746 microversion: 2.20 time: 0.141048 Aug 19 09:22:08.400674 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 395/835] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:08 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1746 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:08.904411 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b1efed65-abf3-4277-bacd-cbd96511224e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:08.905401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b1efed65-abf3-4277-bacd-cbd96511224e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:08.911762 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1efed65-abf3-4277-bacd-cbd96511224e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:08.912209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1efed65-abf3-4277-bacd-cbd96511224e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:08.912967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1efed65-abf3-4277-bacd-cbd96511224e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:08.913401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1efed65-abf3-4277-bacd-cbd96511224e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:09.355769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b1efed65-abf3-4277-bacd-cbd96511224e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 14 microversion: 2.1 time: 0.454824 Aug 19 09:22:09.356650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 441/836] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:08 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 14 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:22:09.418357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-572d19b7-2e3c-4388-8da0-a91fc3a94738 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:09.418986 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-572d19b7-2e3c-4388-8da0-a91fc3a94738 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:09.425498 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-572d19b7-2e3c-4388-8da0-a91fc3a94738 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:09.425950 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-572d19b7-2e3c-4388-8da0-a91fc3a94738 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:09.426814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-572d19b7-2e3c-4388-8da0-a91fc3a94738 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:09.427378 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-572d19b7-2e3c-4388-8da0-a91fc3a94738 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:09.554567 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-572d19b7-2e3c-4388-8da0-a91fc3a94738 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:09.562493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-572d19b7-2e3c-4388-8da0-a91fc3a94738 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:09.563964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-572d19b7-2e3c-4388-8da0-a91fc3a94738 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:09.565194 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-572d19b7-2e3c-4388-8da0-a91fc3a94738 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1746 microversion: 2.20 time: 0.150918 Aug 19 09:22:09.565638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 396/837] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:09 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:10.367148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f058afee-f8b6-4ee2-af4e-0c8a6a24b67f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:10.368161 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f058afee-f8b6-4ee2-af4e-0c8a6a24b67f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:10.374524 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f058afee-f8b6-4ee2-af4e-0c8a6a24b67f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:10.374970 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f058afee-f8b6-4ee2-af4e-0c8a6a24b67f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:10.375760 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f058afee-f8b6-4ee2-af4e-0c8a6a24b67f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:10.376237 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f058afee-f8b6-4ee2-af4e-0c8a6a24b67f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:10.507533 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f058afee-f8b6-4ee2-af4e-0c8a6a24b67f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 14 microversion: 2.1 time: 0.144974 Aug 19 09:22:10.508216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 442/838] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:10 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:22:10.584756 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-094f93c0-72ad-44c5-9c9c-7c0c452e5353 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:10.585350 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-094f93c0-72ad-44c5-9c9c-7c0c452e5353 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:10.591056 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-094f93c0-72ad-44c5-9c9c-7c0c452e5353 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:10.591544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-094f93c0-72ad-44c5-9c9c-7c0c452e5353 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:10.592304 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-094f93c0-72ad-44c5-9c9c-7c0c452e5353 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:10.592735 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-094f93c0-72ad-44c5-9c9c-7c0c452e5353 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:10.716430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-094f93c0-72ad-44c5-9c9c-7c0c452e5353 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:10.725121 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-094f93c0-72ad-44c5-9c9c-7c0c452e5353 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:10.726617 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-094f93c0-72ad-44c5-9c9c-7c0c452e5353 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:10.727785 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-094f93c0-72ad-44c5-9c9c-7c0c452e5353 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1746 microversion: 2.20 time: 0.147379 Aug 19 09:22:10.728334 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 397/839] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:10 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:11.248060 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-d797d54f-6abe-4e61-8d7b-b37fcc811b1b req-c872eb75-1fa7-49dc-b581-16d01ce73888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed06d0a-7ee6-4f00-b470-b19d7331667c", "name": "network-vif-plugged", "status": "completed", "tag": "137293e7-3590-4eee-8e9a-b01076e25605"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:11.249515 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:22:11.249515 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:22:11.257602 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-d797d54f-6abe-4e61-8d7b-b37fcc811b1b req-c872eb75-1fa7-49dc-b581-16d01ce73888 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:11.258091 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-d797d54f-6abe-4e61-8d7b-b37fcc811b1b req-c872eb75-1fa7-49dc-b581-16d01ce73888 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:11.270837 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-d797d54f-6abe-4e61-8d7b-b37fcc811b1b req-c872eb75-1fa7-49dc-b581-16d01ce73888 service nova] Creating event network-vif-plugged:137293e7-3590-4eee-8e9a-b01076e25605 for instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c on hv-cinder-77387 Aug 19 09:22:11.277342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-d797d54f-6abe-4e61-8d7b-b37fcc811b1b req-c872eb75-1fa7-49dc-b581-16d01ce73888 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033275 Aug 19 09:22:11.278149 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 443/840] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:22:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:22:11.517991 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c2db6b7f-0847-4030-b7a6-7d7805a86dd6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:11.518912 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c2db6b7f-0847-4030-b7a6-7d7805a86dd6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:11.525343 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c2db6b7f-0847-4030-b7a6-7d7805a86dd6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:11.525785 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c2db6b7f-0847-4030-b7a6-7d7805a86dd6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:11.526555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c2db6b7f-0847-4030-b7a6-7d7805a86dd6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:11.527033 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c2db6b7f-0847-4030-b7a6-7d7805a86dd6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:11.615010 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c2db6b7f-0847-4030-b7a6-7d7805a86dd6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 14 microversion: 2.1 time: 0.100652 Aug 19 09:22:11.616236 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 398/841] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:11 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 19 09:22:11.746787 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-eefa3e1d-4b08-4793-8363-40643ffd77b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:11.747503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-eefa3e1d-4b08-4793-8363-40643ffd77b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:11.753530 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eefa3e1d-4b08-4793-8363-40643ffd77b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:11.754021 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eefa3e1d-4b08-4793-8363-40643ffd77b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:11.754731 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eefa3e1d-4b08-4793-8363-40643ffd77b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:11.755163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-eefa3e1d-4b08-4793-8363-40643ffd77b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:11.880882 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-eefa3e1d-4b08-4793-8363-40643ffd77b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:11.888957 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-eefa3e1d-4b08-4793-8363-40643ffd77b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:11.890486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-eefa3e1d-4b08-4793-8363-40643ffd77b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:11.891635 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-eefa3e1d-4b08-4793-8363-40643ffd77b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1746 microversion: 2.20 time: 0.148829 Aug 19 09:22:11.892173 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 444/842] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:11 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:12.626580 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-43064a58-bc20-4666-b486-e9b132c77ccd tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:12.627710 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-43064a58-bc20-4666-b486-e9b132c77ccd tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:12.635247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-43064a58-bc20-4666-b486-e9b132c77ccd tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:12.635741 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-43064a58-bc20-4666-b486-e9b132c77ccd tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:12.636516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-43064a58-bc20-4666-b486-e9b132c77ccd tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:12.636953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-43064a58-bc20-4666-b486-e9b132c77ccd tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:12.761974 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-43064a58-bc20-4666-b486-e9b132c77ccd tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 14 microversion: 2.1 time: 0.139228 Aug 19 09:22:12.762799 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 399/843] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:12 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:22:12.909466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a25e6f37-bc22-40c3-a081-b0fff2bf11a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:12.909990 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a25e6f37-bc22-40c3-a081-b0fff2bf11a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:12.916755 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a25e6f37-bc22-40c3-a081-b0fff2bf11a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:12.917196 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a25e6f37-bc22-40c3-a081-b0fff2bf11a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:12.917946 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a25e6f37-bc22-40c3-a081-b0fff2bf11a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:12.918375 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a25e6f37-bc22-40c3-a081-b0fff2bf11a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:13.039683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a25e6f37-bc22-40c3-a081-b0fff2bf11a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:13.047389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a25e6f37-bc22-40c3-a081-b0fff2bf11a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:13.048897 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a25e6f37-bc22-40c3-a081-b0fff2bf11a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:13.050020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a25e6f37-bc22-40c3-a081-b0fff2bf11a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1746 microversion: 2.20 time: 0.144312 Aug 19 09:22:13.050575 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 445/844] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:12 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1746 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:13.773467 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a56a56ae-5b73-4358-a9d9-3b95fb52cc8b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:13.774565 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a56a56ae-5b73-4358-a9d9-3b95fb52cc8b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:13.781261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a56a56ae-5b73-4358-a9d9-3b95fb52cc8b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:13.781721 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a56a56ae-5b73-4358-a9d9-3b95fb52cc8b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:13.782491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a56a56ae-5b73-4358-a9d9-3b95fb52cc8b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:13.782927 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a56a56ae-5b73-4358-a9d9-3b95fb52cc8b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:13.884788 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a56a56ae-5b73-4358-a9d9-3b95fb52cc8b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 487 microversion: 2.1 time: 0.115866 Aug 19 09:22:13.887970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 400/845] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:13 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 487 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:22:14.070237 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d617161e-8b71-42a5-8456-3b70cc0b5520 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:14.071126 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d617161e-8b71-42a5-8456-3b70cc0b5520 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:14.078214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d617161e-8b71-42a5-8456-3b70cc0b5520 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:14.078644 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d617161e-8b71-42a5-8456-3b70cc0b5520 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:14.079481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d617161e-8b71-42a5-8456-3b70cc0b5520 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:14.079907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d617161e-8b71-42a5-8456-3b70cc0b5520 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:14.207026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d617161e-8b71-42a5-8456-3b70cc0b5520 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:14.215751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d617161e-8b71-42a5-8456-3b70cc0b5520 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:14.217304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d617161e-8b71-42a5-8456-3b70cc0b5520 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:14.218440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d617161e-8b71-42a5-8456-3b70cc0b5520 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1741 microversion: 2.20 time: 0.152852 Aug 19 09:22:14.218986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 446/846] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:14 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:14.895790 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-32f26b5d-be95-4f12-9db4-713df3a7873a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:14.897403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-32f26b5d-be95-4f12-9db4-713df3a7873a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:14.904993 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-32f26b5d-be95-4f12-9db4-713df3a7873a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:14.905566 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-32f26b5d-be95-4f12-9db4-713df3a7873a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:14.906638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-32f26b5d-be95-4f12-9db4-713df3a7873a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:14.907161 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-32f26b5d-be95-4f12-9db4-713df3a7873a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:15.240859 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f2ca73e1-a543-4a32-b661-dfd163c71138 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:15.241477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f2ca73e1-a543-4a32-b661-dfd163c71138 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:15.248701 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f2ca73e1-a543-4a32-b661-dfd163c71138 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:15.249151 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f2ca73e1-a543-4a32-b661-dfd163c71138 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:15.249940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f2ca73e1-a543-4a32-b661-dfd163c71138 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:15.250370 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f2ca73e1-a543-4a32-b661-dfd163c71138 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:15.384316 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f2ca73e1-a543-4a32-b661-dfd163c71138 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:15.392438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f2ca73e1-a543-4a32-b661-dfd163c71138 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:15.393944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f2ca73e1-a543-4a32-b661-dfd163c71138 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:15.395080 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f2ca73e1-a543-4a32-b661-dfd163c71138 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1741 microversion: 2.20 time: 0.161021 Aug 19 09:22:15.406460 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 447/847] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:15 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:16.414199 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-dfbdde0d-47b4-42aa-9808-9a451714cfa1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:16.414957 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-dfbdde0d-47b4-42aa-9808-9a451714cfa1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:16.420855 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dfbdde0d-47b4-42aa-9808-9a451714cfa1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:16.421554 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dfbdde0d-47b4-42aa-9808-9a451714cfa1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:16.422343 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dfbdde0d-47b4-42aa-9808-9a451714cfa1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:16.422758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dfbdde0d-47b4-42aa-9808-9a451714cfa1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:16.555490 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dfbdde0d-47b4-42aa-9808-9a451714cfa1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:16.564898 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dfbdde0d-47b4-42aa-9808-9a451714cfa1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:16.566768 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dfbdde0d-47b4-42aa-9808-9a451714cfa1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:16.567936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-dfbdde0d-47b4-42aa-9808-9a451714cfa1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1741 microversion: 2.20 time: 0.157463 Aug 19 09:22:16.568719 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 448/848] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:16 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:17.586623 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-96dfb423-39ee-4a7a-b3b5-dcc3dd4f82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:17.587483 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-96dfb423-39ee-4a7a-b3b5-dcc3dd4f82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:17.593357 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-96dfb423-39ee-4a7a-b3b5-dcc3dd4f82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:17.594182 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-96dfb423-39ee-4a7a-b3b5-dcc3dd4f82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:17.595208 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-96dfb423-39ee-4a7a-b3b5-dcc3dd4f82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:17.595818 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-96dfb423-39ee-4a7a-b3b5-dcc3dd4f82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:17.733653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-96dfb423-39ee-4a7a-b3b5-dcc3dd4f82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:17.742991 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-96dfb423-39ee-4a7a-b3b5-dcc3dd4f82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:17.744816 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-96dfb423-39ee-4a7a-b3b5-dcc3dd4f82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:17.746254 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-96dfb423-39ee-4a7a-b3b5-dcc3dd4f82b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1741 microversion: 2.20 time: 0.163397 Aug 19 09:22:17.757184 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 449/849] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:17 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:18.027635 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-32f26b5d-be95-4f12-9db4-713df3a7873a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 20435 microversion: 2.1 time: 3.135900 Aug 19 09:22:18.028969 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 401/850] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:14 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 20435 bytes in 3138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:22:18.767366 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ef7537a2-01c3-476f-ae28-7bd21c442a75 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:18.768820 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ef7537a2-01c3-476f-ae28-7bd21c442a75 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:18.782099 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ef7537a2-01c3-476f-ae28-7bd21c442a75 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:18.782628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ef7537a2-01c3-476f-ae28-7bd21c442a75 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:18.790393 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ef7537a2-01c3-476f-ae28-7bd21c442a75 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:18.791632 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ef7537a2-01c3-476f-ae28-7bd21c442a75 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:18.978133 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ef7537a2-01c3-476f-ae28-7bd21c442a75 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:18.987976 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ef7537a2-01c3-476f-ae28-7bd21c442a75 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:18.989663 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ef7537a2-01c3-476f-ae28-7bd21c442a75 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:18.990949 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ef7537a2-01c3-476f-ae28-7bd21c442a75 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1741 microversion: 2.20 time: 0.229928 Aug 19 09:22:18.993006 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 450/851] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:18 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:19.041254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1ad2e7bd-0955-480f-adb8-0afa5f6b05bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:19.043235 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1ad2e7bd-0955-480f-adb8-0afa5f6b05bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:19.049609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1ad2e7bd-0955-480f-adb8-0afa5f6b05bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:19.050271 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1ad2e7bd-0955-480f-adb8-0afa5f6b05bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:19.051239 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1ad2e7bd-0955-480f-adb8-0afa5f6b05bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:19.051685 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1ad2e7bd-0955-480f-adb8-0afa5f6b05bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:19.236184 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1ad2e7bd-0955-480f-adb8-0afa5f6b05bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 22841 microversion: 2.1 time: 0.199279 Aug 19 09:22:19.241339 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 402/852] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:19 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 22841 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:22:20.010272 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-652cb3bb-011f-43de-aadf-92204df93a76 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:20.010807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-652cb3bb-011f-43de-aadf-92204df93a76 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:20.017413 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-652cb3bb-011f-43de-aadf-92204df93a76 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:20.018116 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-652cb3bb-011f-43de-aadf-92204df93a76 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:20.019086 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-652cb3bb-011f-43de-aadf-92204df93a76 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:20.019748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-652cb3bb-011f-43de-aadf-92204df93a76 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:20.174767 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-652cb3bb-011f-43de-aadf-92204df93a76 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:20.186017 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-652cb3bb-011f-43de-aadf-92204df93a76 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:20.187995 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-652cb3bb-011f-43de-aadf-92204df93a76 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:20.190601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-652cb3bb-011f-43de-aadf-92204df93a76 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1741 microversion: 2.20 time: 0.184383 Aug 19 09:22:20.191743 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 451/853] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:20 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:20.250252 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-066b1bfd-1f88-422b-a998-da494e224c30 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:20.251363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-066b1bfd-1f88-422b-a998-da494e224c30 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:20.258261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-066b1bfd-1f88-422b-a998-da494e224c30 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:20.258859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-066b1bfd-1f88-422b-a998-da494e224c30 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:20.259714 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-066b1bfd-1f88-422b-a998-da494e224c30 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:20.260555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-066b1bfd-1f88-422b-a998-da494e224c30 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:21.213339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a4339bcb-31f9-420b-aad4-ae67a0d06e52 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:21.214428 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a4339bcb-31f9-420b-aad4-ae67a0d06e52 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:21.220769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4339bcb-31f9-420b-aad4-ae67a0d06e52 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:21.221311 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4339bcb-31f9-420b-aad4-ae67a0d06e52 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:21.222159 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4339bcb-31f9-420b-aad4-ae67a0d06e52 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:21.222665 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a4339bcb-31f9-420b-aad4-ae67a0d06e52 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:21.548610 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a4339bcb-31f9-420b-aad4-ae67a0d06e52 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:21.558368 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a4339bcb-31f9-420b-aad4-ae67a0d06e52 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:21.560306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a4339bcb-31f9-420b-aad4-ae67a0d06e52 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:21.562001 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a4339bcb-31f9-420b-aad4-ae67a0d06e52 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1741 microversion: 2.20 time: 0.355943 Aug 19 09:22:21.562576 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 452/854] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:21 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1741 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:22.580971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cb58048b-4d77-49ac-9aec-e5cb3ced4314 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:22.581595 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cb58048b-4d77-49ac-9aec-e5cb3ced4314 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:22.588306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb58048b-4d77-49ac-9aec-e5cb3ced4314 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:22.588752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb58048b-4d77-49ac-9aec-e5cb3ced4314 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:22.589513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb58048b-4d77-49ac-9aec-e5cb3ced4314 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:22.589940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb58048b-4d77-49ac-9aec-e5cb3ced4314 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:22.717260 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cb58048b-4d77-49ac-9aec-e5cb3ced4314 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:22.729719 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cb58048b-4d77-49ac-9aec-e5cb3ced4314 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:22.731534 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cb58048b-4d77-49ac-9aec-e5cb3ced4314 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:22.732880 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cb58048b-4d77-49ac-9aec-e5cb3ced4314 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1741 microversion: 2.20 time: 0.155792 Aug 19 09:22:22.733612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 453/855] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:22 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:23.753237 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fb6e161a-537a-409d-93b8-c6e589afc5b9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:23.753869 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fb6e161a-537a-409d-93b8-c6e589afc5b9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:23.759874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fb6e161a-537a-409d-93b8-c6e589afc5b9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:23.760326 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fb6e161a-537a-409d-93b8-c6e589afc5b9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:23.761096 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fb6e161a-537a-409d-93b8-c6e589afc5b9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:23.761529 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fb6e161a-537a-409d-93b8-c6e589afc5b9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:23.882019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fb6e161a-537a-409d-93b8-c6e589afc5b9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:23.889797 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fb6e161a-537a-409d-93b8-c6e589afc5b9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:23.891323 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fb6e161a-537a-409d-93b8-c6e589afc5b9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:23.892462 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fb6e161a-537a-409d-93b8-c6e589afc5b9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1741 microversion: 2.20 time: 0.143264 Aug 19 09:22:23.893016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 454/856] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:23 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1741 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:23.922630 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-066b1bfd-1f88-422b-a998-da494e224c30 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 27015 microversion: 2.1 time: 3.677129 Aug 19 09:22:23.923352 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 403/857] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:20 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 27015 bytes in 3679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:22:24.911077 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e1d1b116-0568-49e8-a38c-22f199ba159d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:24.911799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e1d1b116-0568-49e8-a38c-22f199ba159d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:24.917592 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e1d1b116-0568-49e8-a38c-22f199ba159d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:24.918031 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e1d1b116-0568-49e8-a38c-22f199ba159d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:24.918781 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e1d1b116-0568-49e8-a38c-22f199ba159d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:24.919209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e1d1b116-0568-49e8-a38c-22f199ba159d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:24.934717 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e8237cc4-fc59-43de-b1dc-ea156475d2d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:24.936031 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e8237cc4-fc59-43de-b1dc-ea156475d2d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:24.942373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e8237cc4-fc59-43de-b1dc-ea156475d2d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:24.943000 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e8237cc4-fc59-43de-b1dc-ea156475d2d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:24.943985 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e8237cc4-fc59-43de-b1dc-ea156475d2d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:24.945343 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e8237cc4-fc59-43de-b1dc-ea156475d2d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:25.043857 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e1d1b116-0568-49e8-a38c-22f199ba159d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:25.053292 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e1d1b116-0568-49e8-a38c-22f199ba159d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:25.056443 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e1d1b116-0568-49e8-a38c-22f199ba159d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:25.058435 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e1d1b116-0568-49e8-a38c-22f199ba159d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1741 microversion: 2.20 time: 0.150751 Aug 19 09:22:25.059291 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 455/858] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:24 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:25.083508 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e8237cc4-fc59-43de-b1dc-ea156475d2d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 27350 microversion: 2.1 time: 0.152590 Aug 19 09:22:25.084555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 404/859] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:24 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 27350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:22:25.850635 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:22:25.851530 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: Thu Aug 19 09:22:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:22:26.076866 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-88c90649-fdfc-4195-b75d-39a427dfd1b0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:26.077488 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-88c90649-fdfc-4195-b75d-39a427dfd1b0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:26.083312 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-88c90649-fdfc-4195-b75d-39a427dfd1b0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:26.083776 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-88c90649-fdfc-4195-b75d-39a427dfd1b0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:26.084538 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-88c90649-fdfc-4195-b75d-39a427dfd1b0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:26.084973 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-88c90649-fdfc-4195-b75d-39a427dfd1b0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:26.095890 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2ca5cf51-daf9-43fc-841a-800e3f300bbf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:26.096916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2ca5cf51-daf9-43fc-841a-800e3f300bbf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:26.104485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2ca5cf51-daf9-43fc-841a-800e3f300bbf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:26.104943 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2ca5cf51-daf9-43fc-841a-800e3f300bbf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:26.105720 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2ca5cf51-daf9-43fc-841a-800e3f300bbf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:26.106254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2ca5cf51-daf9-43fc-841a-800e3f300bbf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:26.210800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-88c90649-fdfc-4195-b75d-39a427dfd1b0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:26.218790 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-88c90649-fdfc-4195-b75d-39a427dfd1b0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:26.220366 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-88c90649-fdfc-4195-b75d-39a427dfd1b0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:26.221520 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-88c90649-fdfc-4195-b75d-39a427dfd1b0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1723 microversion: 2.20 time: 0.148463 Aug 19 09:22:26.222049 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 456/860] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:26 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:27.240715 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1532d67d-aa18-4fac-8cfb-c607da58bb56 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:27.241434 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1532d67d-aa18-4fac-8cfb-c607da58bb56 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:27.247195 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1532d67d-aa18-4fac-8cfb-c607da58bb56 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:27.247663 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1532d67d-aa18-4fac-8cfb-c607da58bb56 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:27.248409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1532d67d-aa18-4fac-8cfb-c607da58bb56 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:27.248834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1532d67d-aa18-4fac-8cfb-c607da58bb56 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:27.377358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1532d67d-aa18-4fac-8cfb-c607da58bb56 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:27.385648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1532d67d-aa18-4fac-8cfb-c607da58bb56 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:27.387136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1532d67d-aa18-4fac-8cfb-c607da58bb56 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:27.388281 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1532d67d-aa18-4fac-8cfb-c607da58bb56 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1723 microversion: 2.20 time: 0.151233 Aug 19 09:22:27.388823 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 457/861] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:27 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:27.829242 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-d32a93a8-4f96-4110-acb5-6fddfb2e6bc8 req-912159dc-4a34-45eb-9a8b-9bdb971375c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed06d0a-7ee6-4f00-b470-b19d7331667c", "name": "network-vif-unplugged", "status": "completed", "tag": "137293e7-3590-4eee-8e9a-b01076e25605"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:27.830804 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:22:27.830804 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:22:27.838124 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-d32a93a8-4f96-4110-acb5-6fddfb2e6bc8 req-912159dc-4a34-45eb-9a8b-9bdb971375c0 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:27.838568 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-d32a93a8-4f96-4110-acb5-6fddfb2e6bc8 req-912159dc-4a34-45eb-9a8b-9bdb971375c0 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:27.849770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-d32a93a8-4f96-4110-acb5-6fddfb2e6bc8 req-912159dc-4a34-45eb-9a8b-9bdb971375c0 service nova] Creating event network-vif-unplugged:137293e7-3590-4eee-8e9a-b01076e25605 for instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c on hv-cinder-77387 Aug 19 09:22:27.854679 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-d32a93a8-4f96-4110-acb5-6fddfb2e6bc8 req-912159dc-4a34-45eb-9a8b-9bdb971375c0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029093 Aug 19 09:22:27.855246 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 458/862] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:22:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:22:28.407594 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6a0f5725-934f-44da-a633-018ac61cd91c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:28.408279 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6a0f5725-934f-44da-a633-018ac61cd91c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:28.414107 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a0f5725-934f-44da-a633-018ac61cd91c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:28.414548 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a0f5725-934f-44da-a633-018ac61cd91c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:28.415328 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a0f5725-934f-44da-a633-018ac61cd91c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:28.415761 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a0f5725-934f-44da-a633-018ac61cd91c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:28.544491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6a0f5725-934f-44da-a633-018ac61cd91c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:28.552092 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6a0f5725-934f-44da-a633-018ac61cd91c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:28.553581 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6a0f5725-934f-44da-a633-018ac61cd91c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:28.554768 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6a0f5725-934f-44da-a633-018ac61cd91c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1723 microversion: 2.20 time: 0.151596 Aug 19 09:22:28.555334 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 459/863] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:28 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:29.572524 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5e026e01-62bc-4537-a374-1ff4d65d61c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:29.573129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5e026e01-62bc-4537-a374-1ff4d65d61c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:29.578746 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5e026e01-62bc-4537-a374-1ff4d65d61c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:29.579196 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5e026e01-62bc-4537-a374-1ff4d65d61c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:29.579979 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5e026e01-62bc-4537-a374-1ff4d65d61c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:29.580410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5e026e01-62bc-4537-a374-1ff4d65d61c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:29.696925 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5e026e01-62bc-4537-a374-1ff4d65d61c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:29.704446 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5e026e01-62bc-4537-a374-1ff4d65d61c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:29.705941 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5e026e01-62bc-4537-a374-1ff4d65d61c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:29.707051 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5e026e01-62bc-4537-a374-1ff4d65d61c1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1723 microversion: 2.20 time: 0.138249 Aug 19 09:22:29.707622 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 460/864] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:29 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1723 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:30.205903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2ca5cf51-daf9-43fc-841a-800e3f300bbf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 27831 microversion: 2.1 time: 4.113762 Aug 19 09:22:30.206558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 405/865] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:26 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 27831 bytes in 4115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:22:30.726222 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-11fecbb5-d5c9-4338-b8ce-cb0222caf996 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:30.726823 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-11fecbb5-d5c9-4338-b8ce-cb0222caf996 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:30.732619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-11fecbb5-d5c9-4338-b8ce-cb0222caf996 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:30.733054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-11fecbb5-d5c9-4338-b8ce-cb0222caf996 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:30.733800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-11fecbb5-d5c9-4338-b8ce-cb0222caf996 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:30.734225 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-11fecbb5-d5c9-4338-b8ce-cb0222caf996 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:30.854416 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-11fecbb5-d5c9-4338-b8ce-cb0222caf996 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:30.862078 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-11fecbb5-d5c9-4338-b8ce-cb0222caf996 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:30.863735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-11fecbb5-d5c9-4338-b8ce-cb0222caf996 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:30.864864 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-11fecbb5-d5c9-4338-b8ce-cb0222caf996 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1723 microversion: 2.20 time: 0.142860 Aug 19 09:22:30.865415 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 461/866] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:30 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:31.218737 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-52be83a5-09b2-4eb6-8af9-35c1ec3d3026 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:31.219829 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-52be83a5-09b2-4eb6-8af9-35c1ec3d3026 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:31.226414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-52be83a5-09b2-4eb6-8af9-35c1ec3d3026 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:31.226859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-52be83a5-09b2-4eb6-8af9-35c1ec3d3026 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:31.227647 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-52be83a5-09b2-4eb6-8af9-35c1ec3d3026 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:31.228084 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-52be83a5-09b2-4eb6-8af9-35c1ec3d3026 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:31.318438 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-52be83a5-09b2-4eb6-8af9-35c1ec3d3026 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 27831 microversion: 2.1 time: 0.103508 Aug 19 09:22:31.319998 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 406/867] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:31 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 27831 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:22:31.884752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5bdc6b01-2072-4f9a-bbf4-016fbe6ec1d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:31.885521 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5bdc6b01-2072-4f9a-bbf4-016fbe6ec1d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:31.891497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5bdc6b01-2072-4f9a-bbf4-016fbe6ec1d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:31.891926 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5bdc6b01-2072-4f9a-bbf4-016fbe6ec1d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:31.892687 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5bdc6b01-2072-4f9a-bbf4-016fbe6ec1d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:31.893115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5bdc6b01-2072-4f9a-bbf4-016fbe6ec1d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:32.106676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5bdc6b01-2072-4f9a-bbf4-016fbe6ec1d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:32.114238 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5bdc6b01-2072-4f9a-bbf4-016fbe6ec1d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:32.115745 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5bdc6b01-2072-4f9a-bbf4-016fbe6ec1d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:32.116897 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5bdc6b01-2072-4f9a-bbf4-016fbe6ec1d2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1723 microversion: 2.20 time: 0.236798 Aug 19 09:22:32.117429 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 462/868] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:31 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:32.330731 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-fd62ee17-5598-4346-a422-e558d44ced4a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:32.331682 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-fd62ee17-5598-4346-a422-e558d44ced4a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:32.338754 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fd62ee17-5598-4346-a422-e558d44ced4a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:32.339191 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fd62ee17-5598-4346-a422-e558d44ced4a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:32.340103 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fd62ee17-5598-4346-a422-e558d44ced4a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:32.340530 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fd62ee17-5598-4346-a422-e558d44ced4a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:33.133846 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-27c6956a-5464-41b3-923b-9ba8a0843a36 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:33.134439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-27c6956a-5464-41b3-923b-9ba8a0843a36 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:33.140159 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27c6956a-5464-41b3-923b-9ba8a0843a36 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:33.140608 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27c6956a-5464-41b3-923b-9ba8a0843a36 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:33.141367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27c6956a-5464-41b3-923b-9ba8a0843a36 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:33.141799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27c6956a-5464-41b3-923b-9ba8a0843a36 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:33.260254 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-27c6956a-5464-41b3-923b-9ba8a0843a36 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:33.268220 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-27c6956a-5464-41b3-923b-9ba8a0843a36 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:33.269723 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-27c6956a-5464-41b3-923b-9ba8a0843a36 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:33.270841 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-27c6956a-5464-41b3-923b-9ba8a0843a36 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1723 microversion: 2.20 time: 0.140936 Aug 19 09:22:33.271411 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 463/869] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:33 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:34.288581 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b401bf3d-abb5-4657-8005-e5346951af6e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:34.289297 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b401bf3d-abb5-4657-8005-e5346951af6e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:34.295070 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b401bf3d-abb5-4657-8005-e5346951af6e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:34.295546 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b401bf3d-abb5-4657-8005-e5346951af6e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:34.296300 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b401bf3d-abb5-4657-8005-e5346951af6e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:34.296729 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b401bf3d-abb5-4657-8005-e5346951af6e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:34.418864 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b401bf3d-abb5-4657-8005-e5346951af6e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:34.426423 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b401bf3d-abb5-4657-8005-e5346951af6e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:34.427944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b401bf3d-abb5-4657-8005-e5346951af6e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:34.429294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b401bf3d-abb5-4657-8005-e5346951af6e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1723 microversion: 2.20 time: 0.144473 Aug 19 09:22:34.429838 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 464/870] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:34 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:35.447024 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e0b13cfa-6aa2-4cbb-b186-e1b7d31caef8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:35.447686 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e0b13cfa-6aa2-4cbb-b186-e1b7d31caef8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:35.453502 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0b13cfa-6aa2-4cbb-b186-e1b7d31caef8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:35.453944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0b13cfa-6aa2-4cbb-b186-e1b7d31caef8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:35.454691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0b13cfa-6aa2-4cbb-b186-e1b7d31caef8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:35.455118 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0b13cfa-6aa2-4cbb-b186-e1b7d31caef8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:35.571921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e0b13cfa-6aa2-4cbb-b186-e1b7d31caef8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:35.579599 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e0b13cfa-6aa2-4cbb-b186-e1b7d31caef8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:35.581086 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e0b13cfa-6aa2-4cbb-b186-e1b7d31caef8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:35.582204 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e0b13cfa-6aa2-4cbb-b186-e1b7d31caef8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1723 microversion: 2.20 time: 0.138908 Aug 19 09:22:35.582754 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 465/871] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:35 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:36.577253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-fd62ee17-5598-4346-a422-e558d44ced4a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 27957 microversion: 2.1 time: 4.250393 Aug 19 09:22:36.577935 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 407/872] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:32 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 27957 bytes in 4252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:22:36.601213 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b81fe3c2-b084-450f-8b70-0e84890fa732 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:36.601889 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b81fe3c2-b084-450f-8b70-0e84890fa732 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:36.607531 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b81fe3c2-b084-450f-8b70-0e84890fa732 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:36.608005 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b81fe3c2-b084-450f-8b70-0e84890fa732 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:36.608758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b81fe3c2-b084-450f-8b70-0e84890fa732 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:36.609189 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b81fe3c2-b084-450f-8b70-0e84890fa732 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:36.733179 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b81fe3c2-b084-450f-8b70-0e84890fa732 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:36.743693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b81fe3c2-b084-450f-8b70-0e84890fa732 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:36.746067 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b81fe3c2-b084-450f-8b70-0e84890fa732 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:36.749070 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b81fe3c2-b084-450f-8b70-0e84890fa732 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1723 microversion: 2.20 time: 0.150152 Aug 19 09:22:36.749983 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 466/873] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:36 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:37.590146 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f73fcd37-a7ad-40d1-b4f3-7fa9a2de92ea tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:37.591055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f73fcd37-a7ad-40d1-b4f3-7fa9a2de92ea tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:37.597364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f73fcd37-a7ad-40d1-b4f3-7fa9a2de92ea tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:37.597806 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f73fcd37-a7ad-40d1-b4f3-7fa9a2de92ea tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:37.598560 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f73fcd37-a7ad-40d1-b4f3-7fa9a2de92ea tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:37.599245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f73fcd37-a7ad-40d1-b4f3-7fa9a2de92ea tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:37.696253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f73fcd37-a7ad-40d1-b4f3-7fa9a2de92ea tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28076 microversion: 2.1 time: 0.109703 Aug 19 09:22:37.696991 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 408/874] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:37 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28076 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:22:37.766915 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-41255893-17ca-4b6e-9dc3-aae2de255087 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:37.767561 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-41255893-17ca-4b6e-9dc3-aae2de255087 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:37.774555 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41255893-17ca-4b6e-9dc3-aae2de255087 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:37.775005 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41255893-17ca-4b6e-9dc3-aae2de255087 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:37.775799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41255893-17ca-4b6e-9dc3-aae2de255087 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:37.776234 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-41255893-17ca-4b6e-9dc3-aae2de255087 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:37.898547 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-41255893-17ca-4b6e-9dc3-aae2de255087 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:37.906240 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-41255893-17ca-4b6e-9dc3-aae2de255087 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:37.907758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-41255893-17ca-4b6e-9dc3-aae2de255087 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:37.908869 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-41255893-17ca-4b6e-9dc3-aae2de255087 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1666 microversion: 2.20 time: 0.145687 Aug 19 09:22:37.909418 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 467/875] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:37 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1666 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:37.926850 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-016714f7-8047-48a6-8b91-a4a2dbf7a92c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efaa1bff-27db-4cf7-bdc7-2c313ee7521b"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:37.928011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-016714f7-8047-48a6-8b91-a4a2dbf7a92c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:37.934793 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-016714f7-8047-48a6-8b91-a4a2dbf7a92c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:37.935245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-016714f7-8047-48a6-8b91-a4a2dbf7a92c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:37.936066 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-016714f7-8047-48a6-8b91-a4a2dbf7a92c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:37.936499 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-016714f7-8047-48a6-8b91-a4a2dbf7a92c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:38.248415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-016714f7-8047-48a6-8b91-a4a2dbf7a92c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325727 Aug 19 09:22:38.249036 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 409/876] 10.222.0.32 () {62 vars in 1364 bytes} [Thu Aug 19 09:22:37 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-volume_attachments => generated 188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:22:38.367832 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-898e2747-0e39-47bd-9afe-179d898b2058 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:38.368392 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-898e2747-0e39-47bd-9afe-179d898b2058 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:38.374183 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-898e2747-0e39-47bd-9afe-179d898b2058 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:38.374633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-898e2747-0e39-47bd-9afe-179d898b2058 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:38.375436 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-898e2747-0e39-47bd-9afe-179d898b2058 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:38.375870 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-898e2747-0e39-47bd-9afe-179d898b2058 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:38.454031 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-898e2747-0e39-47bd-9afe-179d898b2058 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action" status: 202 len: 0 microversion: 2.20 time: 0.090314 Aug 19 09:22:38.454549 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 468/877] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:22:38 2021] POST /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:22:38.462628 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b5f51a87-cac9-43a4-8675-2221584495c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:38.463266 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b5f51a87-cac9-43a4-8675-2221584495c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:38.469517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b5f51a87-cac9-43a4-8675-2221584495c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:38.469961 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b5f51a87-cac9-43a4-8675-2221584495c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:38.470719 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b5f51a87-cac9-43a4-8675-2221584495c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:38.471207 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b5f51a87-cac9-43a4-8675-2221584495c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:38.594035 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b5f51a87-cac9-43a4-8675-2221584495c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:38.603088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b5f51a87-cac9-43a4-8675-2221584495c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:38.604634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b5f51a87-cac9-43a4-8675-2221584495c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:38.605772 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b5f51a87-cac9-43a4-8675-2221584495c3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1752 microversion: 2.20 time: 0.147077 Aug 19 09:22:38.606502 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 410/878] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:38 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1752 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:38.707931 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-bcfcbe50-b03e-40f7-8b19-bd0b6aff01ce tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:38.708775 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-bcfcbe50-b03e-40f7-8b19-bd0b6aff01ce tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:38.715210 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bcfcbe50-b03e-40f7-8b19-bd0b6aff01ce tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:38.715739 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bcfcbe50-b03e-40f7-8b19-bd0b6aff01ce tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:38.716501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bcfcbe50-b03e-40f7-8b19-bd0b6aff01ce tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:38.717035 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bcfcbe50-b03e-40f7-8b19-bd0b6aff01ce tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:39.624143 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-deb50533-87c3-44a3-90d6-4745ca7bd9a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:39.624754 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-deb50533-87c3-44a3-90d6-4745ca7bd9a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:39.630950 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-deb50533-87c3-44a3-90d6-4745ca7bd9a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:39.631451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-deb50533-87c3-44a3-90d6-4745ca7bd9a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:39.632900 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-deb50533-87c3-44a3-90d6-4745ca7bd9a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:39.633334 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-deb50533-87c3-44a3-90d6-4745ca7bd9a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:39.752615 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-deb50533-87c3-44a3-90d6-4745ca7bd9a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:39.761129 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-deb50533-87c3-44a3-90d6-4745ca7bd9a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:39.762607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-deb50533-87c3-44a3-90d6-4745ca7bd9a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:39.764059 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-deb50533-87c3-44a3-90d6-4745ca7bd9a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1752 microversion: 2.20 time: 0.143331 Aug 19 09:22:39.764716 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 411/879] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:39 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1752 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:40.781357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b6a25334-7122-4860-a224-af483dfb45b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:40.781988 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b6a25334-7122-4860-a224-af483dfb45b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:40.788319 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b6a25334-7122-4860-a224-af483dfb45b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:40.788752 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b6a25334-7122-4860-a224-af483dfb45b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:40.789698 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b6a25334-7122-4860-a224-af483dfb45b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:40.790126 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b6a25334-7122-4860-a224-af483dfb45b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:40.908383 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b6a25334-7122-4860-a224-af483dfb45b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:40.916913 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b6a25334-7122-4860-a224-af483dfb45b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:40.918380 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b6a25334-7122-4860-a224-af483dfb45b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:40.919568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b6a25334-7122-4860-a224-af483dfb45b2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1752 microversion: 2.20 time: 0.141892 Aug 19 09:22:40.920123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 412/880] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:40 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1752 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:41.936769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4f1cac02-540f-4dfa-bdb1-d8524bf9aa16 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:41.937502 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4f1cac02-540f-4dfa-bdb1-d8524bf9aa16 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:41.943793 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4f1cac02-540f-4dfa-bdb1-d8524bf9aa16 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:41.944236 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4f1cac02-540f-4dfa-bdb1-d8524bf9aa16 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:41.945114 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4f1cac02-540f-4dfa-bdb1-d8524bf9aa16 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:41.945634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4f1cac02-540f-4dfa-bdb1-d8524bf9aa16 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:42.054458 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-bcfcbe50-b03e-40f7-8b19-bd0b6aff01ce tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28076 microversion: 2.1 time: 3.349790 Aug 19 09:22:42.056323 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 469/881] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:38 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28076 bytes in 3352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:22:42.064796 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4f1cac02-540f-4dfa-bdb1-d8524bf9aa16 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:42.073452 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4f1cac02-540f-4dfa-bdb1-d8524bf9aa16 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:42.075201 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4f1cac02-540f-4dfa-bdb1-d8524bf9aa16 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:42.076482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4f1cac02-540f-4dfa-bdb1-d8524bf9aa16 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1752 microversion: 2.20 time: 0.143449 Aug 19 09:22:42.077051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 413/882] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:41 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1752 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:43.067190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ab413edf-bbbd-43a6-9bfe-f96d8d117e26 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:43.068238 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ab413edf-bbbd-43a6-9bfe-f96d8d117e26 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:43.076078 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ab413edf-bbbd-43a6-9bfe-f96d8d117e26 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:43.076530 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ab413edf-bbbd-43a6-9bfe-f96d8d117e26 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:43.077301 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ab413edf-bbbd-43a6-9bfe-f96d8d117e26 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:43.077738 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ab413edf-bbbd-43a6-9bfe-f96d8d117e26 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:43.094534 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cae392c3-98b9-42d2-b1ba-6ec49a228915 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:43.095066 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-cae392c3-98b9-42d2-b1ba-6ec49a228915 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:43.102124 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cae392c3-98b9-42d2-b1ba-6ec49a228915 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:43.102574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cae392c3-98b9-42d2-b1ba-6ec49a228915 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:43.103384 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cae392c3-98b9-42d2-b1ba-6ec49a228915 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:43.103822 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cae392c3-98b9-42d2-b1ba-6ec49a228915 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:43.168951 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ab413edf-bbbd-43a6-9bfe-f96d8d117e26 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28193 microversion: 2.1 time: 0.105771 Aug 19 09:22:43.169925 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 470/883] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:43 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28193 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:22:43.229378 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-cae392c3-98b9-42d2-b1ba-6ec49a228915 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:43.237915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-cae392c3-98b9-42d2-b1ba-6ec49a228915 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:43.239417 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-cae392c3-98b9-42d2-b1ba-6ec49a228915 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:43.240545 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-cae392c3-98b9-42d2-b1ba-6ec49a228915 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1754 microversion: 2.20 time: 0.150055 Aug 19 09:22:43.241089 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 414/884] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:43 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:43.879668 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4c73aaa2-f85f-45d3-a958-2fe92584e8e7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:43.880236 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4c73aaa2-f85f-45d3-a958-2fe92584e8e7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:43.887174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c73aaa2-f85f-45d3-a958-2fe92584e8e7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:43.887655 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c73aaa2-f85f-45d3-a958-2fe92584e8e7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:43.888414 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c73aaa2-f85f-45d3-a958-2fe92584e8e7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:43.888840 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4c73aaa2-f85f-45d3-a958-2fe92584e8e7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:43.974464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-4c73aaa2-f85f-45d3-a958-2fe92584e8e7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lazy-loading 'services' on Instance uuid 2db6043f-4b5d-4736-9623-cc4a3220ba35 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:22:44.041438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4c73aaa2-f85f-45d3-a958-2fe92584e8e7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35/os-volume_attachments/0b6a88ed-66fd-4352-821d-6c3dc2d2d94d" status: 202 len: 0 microversion: 2.1 time: 0.165359 Aug 19 09:22:44.042494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 471/885] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:22:43 2021] DELETE /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35/os-volume_attachments/0b6a88ed-66fd-4352-821d-6c3dc2d2d94d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:22:44.184122 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-88166d3e-7c90-4f40-aa8c-8dc2615d821b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:44.186333 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-88166d3e-7c90-4f40-aa8c-8dc2615d821b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:44.194175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88166d3e-7c90-4f40-aa8c-8dc2615d821b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:44.194628 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88166d3e-7c90-4f40-aa8c-8dc2615d821b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:44.196274 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88166d3e-7c90-4f40-aa8c-8dc2615d821b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:44.196717 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-88166d3e-7c90-4f40-aa8c-8dc2615d821b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:44.260366 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-75b81f32-6e0c-4f27-b4ac-92dd4fc927ff tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:44.261071 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-75b81f32-6e0c-4f27-b4ac-92dd4fc927ff tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:44.267593 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75b81f32-6e0c-4f27-b4ac-92dd4fc927ff tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:44.268045 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75b81f32-6e0c-4f27-b4ac-92dd4fc927ff tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:44.268828 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75b81f32-6e0c-4f27-b4ac-92dd4fc927ff tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:44.269263 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75b81f32-6e0c-4f27-b4ac-92dd4fc927ff tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:44.294312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-88166d3e-7c90-4f40-aa8c-8dc2615d821b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28193 microversion: 2.1 time: 0.117348 Aug 19 09:22:44.298269 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 415/886] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:44 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28193 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:22:44.395971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-75b81f32-6e0c-4f27-b4ac-92dd4fc927ff tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:44.404183 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-75b81f32-6e0c-4f27-b4ac-92dd4fc927ff tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:44.405678 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-75b81f32-6e0c-4f27-b4ac-92dd4fc927ff tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:44.406804 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-75b81f32-6e0c-4f27-b4ac-92dd4fc927ff tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.151015 Aug 19 09:22:44.407384 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 472/887] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:44 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:45.182533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-81db9ad6-4758-44a4-909c-f8f7af9e3b60 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:45.183376 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-81db9ad6-4758-44a4-909c-f8f7af9e3b60 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:45.191977 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-81db9ad6-4758-44a4-909c-f8f7af9e3b60 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:45.193317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-81db9ad6-4758-44a4-909c-f8f7af9e3b60 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:45.194354 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-81db9ad6-4758-44a4-909c-f8f7af9e3b60 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:45.195082 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-81db9ad6-4758-44a4-909c-f8f7af9e3b60 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:45.224446 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-81db9ad6-4758-44a4-909c-f8f7af9e3b60 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:22:45.307029 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4011fa5d-0043-4bcc-af5b-8c287610fdf0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:22:45.308847 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4011fa5d-0043-4bcc-af5b-8c287610fdf0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:45.324749 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4011fa5d-0043-4bcc-af5b-8c287610fdf0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:45.326325 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4011fa5d-0043-4bcc-af5b-8c287610fdf0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:45.327875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4011fa5d-0043-4bcc-af5b-8c287610fdf0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:45.328960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4011fa5d-0043-4bcc-af5b-8c287610fdf0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:45.398149 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-81db9ad6-4758-44a4-909c-f8f7af9e3b60 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 204 len: 0 microversion: 2.1 time: 0.219475 Aug 19 09:22:45.402829 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 416/888] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:22:45 2021] DELETE /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:22:45.416310 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8ed21d24-54df-47f2-8079-583b405ae5a5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:45.417171 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8ed21d24-54df-47f2-8079-583b405ae5a5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:45.425551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ed21d24-54df-47f2-8079-583b405ae5a5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:45.426084 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ed21d24-54df-47f2-8079-583b405ae5a5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:45.427095 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ed21d24-54df-47f2-8079-583b405ae5a5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:45.427755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ed21d24-54df-47f2-8079-583b405ae5a5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:45.561297 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8ed21d24-54df-47f2-8079-583b405ae5a5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:45.570041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8ed21d24-54df-47f2-8079-583b405ae5a5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.162058 Aug 19 09:22:45.571140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 417/889] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:45 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:22:45.576491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8370571a-29eb-41f4-a462-f2c51ca8be48 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:45.577324 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8370571a-29eb-41f4-a462-f2c51ca8be48 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:45.583819 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8370571a-29eb-41f4-a462-f2c51ca8be48 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:45.584260 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8370571a-29eb-41f4-a462-f2c51ca8be48 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:45.585030 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8370571a-29eb-41f4-a462-f2c51ca8be48 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:45.585995 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8370571a-29eb-41f4-a462-f2c51ca8be48 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:45.715115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8370571a-29eb-41f4-a462-f2c51ca8be48 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:45.724817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8370571a-29eb-41f4-a462-f2c51ca8be48 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:45.726574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8370571a-29eb-41f4-a462-f2c51ca8be48 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:45.728249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8370571a-29eb-41f4-a462-f2c51ca8be48 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.155581 Aug 19 09:22:45.728797 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 418/890] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:45 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:46.587612 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-af9b48c6-2eab-41f3-a8f5-0bfa7c987a64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:46.588249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-af9b48c6-2eab-41f3-a8f5-0bfa7c987a64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:46.594130 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af9b48c6-2eab-41f3-a8f5-0bfa7c987a64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:46.594567 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af9b48c6-2eab-41f3-a8f5-0bfa7c987a64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:46.595357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af9b48c6-2eab-41f3-a8f5-0bfa7c987a64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:46.595783 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af9b48c6-2eab-41f3-a8f5-0bfa7c987a64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:46.721813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-af9b48c6-2eab-41f3-a8f5-0bfa7c987a64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:46.729759 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-af9b48c6-2eab-41f3-a8f5-0bfa7c987a64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.145954 Aug 19 09:22:46.730316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 419/891] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:46 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:46.746009 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b37146e7-0813-40fa-9405-3fcf23a53da0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:46.746615 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b37146e7-0813-40fa-9405-3fcf23a53da0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:46.752584 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b37146e7-0813-40fa-9405-3fcf23a53da0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:46.753035 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b37146e7-0813-40fa-9405-3fcf23a53da0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:46.753808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b37146e7-0813-40fa-9405-3fcf23a53da0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:46.754243 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b37146e7-0813-40fa-9405-3fcf23a53da0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:46.884585 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b37146e7-0813-40fa-9405-3fcf23a53da0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:46.893025 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b37146e7-0813-40fa-9405-3fcf23a53da0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:46.894531 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b37146e7-0813-40fa-9405-3fcf23a53da0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:46.895730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b37146e7-0813-40fa-9405-3fcf23a53da0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.153979 Aug 19 09:22:46.896289 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 420/892] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:46 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:47.747022 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b1559e23-6f87-44f4-8ace-2ba409556a6d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:47.747717 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b1559e23-6f87-44f4-8ace-2ba409556a6d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:47.754048 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b1559e23-6f87-44f4-8ace-2ba409556a6d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:47.754493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b1559e23-6f87-44f4-8ace-2ba409556a6d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:47.755300 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b1559e23-6f87-44f4-8ace-2ba409556a6d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:47.755886 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b1559e23-6f87-44f4-8ace-2ba409556a6d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:47.883175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b1559e23-6f87-44f4-8ace-2ba409556a6d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:47.890882 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b1559e23-6f87-44f4-8ace-2ba409556a6d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.147532 Aug 19 09:22:47.895135 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 421/893] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:47 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:47.914302 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-01901203-c8df-429d-b000-fcb88b45dda5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:47.914908 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-01901203-c8df-429d-b000-fcb88b45dda5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:47.920764 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01901203-c8df-429d-b000-fcb88b45dda5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:47.921211 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01901203-c8df-429d-b000-fcb88b45dda5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:47.921969 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01901203-c8df-429d-b000-fcb88b45dda5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:47.922397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-01901203-c8df-429d-b000-fcb88b45dda5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:48.058897 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-01901203-c8df-429d-b000-fcb88b45dda5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:48.068085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-01901203-c8df-429d-b000-fcb88b45dda5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:48.070573 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-01901203-c8df-429d-b000-fcb88b45dda5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:48.071681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-01901203-c8df-429d-b000-fcb88b45dda5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.161489 Aug 19 09:22:48.074665 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 422/894] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:47 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:48.908197 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d319a483-aea3-4acf-b9a9-588b747c69f9 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:48.908862 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d319a483-aea3-4acf-b9a9-588b747c69f9 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:48.916181 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d319a483-aea3-4acf-b9a9-588b747c69f9 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:48.916634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d319a483-aea3-4acf-b9a9-588b747c69f9 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:48.917425 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d319a483-aea3-4acf-b9a9-588b747c69f9 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:48.917849 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d319a483-aea3-4acf-b9a9-588b747c69f9 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:49.045875 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d319a483-aea3-4acf-b9a9-588b747c69f9 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:49.055634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d319a483-aea3-4acf-b9a9-588b747c69f9 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.150279 Aug 19 09:22:49.056583 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 423/895] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:48 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:49.089706 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1f545fe2-b1f4-4239-94e4-573724e84718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:49.090300 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1f545fe2-b1f4-4239-94e4-573724e84718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:49.096172 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1f545fe2-b1f4-4239-94e4-573724e84718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:49.096613 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1f545fe2-b1f4-4239-94e4-573724e84718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:49.097375 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1f545fe2-b1f4-4239-94e4-573724e84718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:49.097802 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1f545fe2-b1f4-4239-94e4-573724e84718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:49.215136 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1f545fe2-b1f4-4239-94e4-573724e84718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:49.223230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1f545fe2-b1f4-4239-94e4-573724e84718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:49.225004 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1f545fe2-b1f4-4239-94e4-573724e84718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:49.226129 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1f545fe2-b1f4-4239-94e4-573724e84718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.140151 Aug 19 09:22:49.226730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 424/896] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:49 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:50.073910 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0ef5ab41-1864-47ff-b2a0-c81fa91c6a9e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:50.074724 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0ef5ab41-1864-47ff-b2a0-c81fa91c6a9e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:50.081228 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ef5ab41-1864-47ff-b2a0-c81fa91c6a9e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:50.081674 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ef5ab41-1864-47ff-b2a0-c81fa91c6a9e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:50.082438 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ef5ab41-1864-47ff-b2a0-c81fa91c6a9e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:50.082869 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ef5ab41-1864-47ff-b2a0-c81fa91c6a9e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:50.213862 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0ef5ab41-1864-47ff-b2a0-c81fa91c6a9e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:50.221557 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0ef5ab41-1864-47ff-b2a0-c81fa91c6a9e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.152008 Aug 19 09:22:50.222339 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 425/897] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:50 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:22:50.245061 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7345242e-4d05-4087-a37e-20762b23d821 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:50.245669 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7345242e-4d05-4087-a37e-20762b23d821 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:50.251546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7345242e-4d05-4087-a37e-20762b23d821 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:50.252001 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7345242e-4d05-4087-a37e-20762b23d821 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:50.252769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7345242e-4d05-4087-a37e-20762b23d821 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:50.253199 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7345242e-4d05-4087-a37e-20762b23d821 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:50.378899 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7345242e-4d05-4087-a37e-20762b23d821 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:50.388086 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7345242e-4d05-4087-a37e-20762b23d821 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:50.389572 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7345242e-4d05-4087-a37e-20762b23d821 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:50.390699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7345242e-4d05-4087-a37e-20762b23d821 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.150240 Aug 19 09:22:50.391258 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 426/898] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:50 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:51.238767 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-532c4349-e9d4-4acf-b3e5-5d8dc9c83239 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:51.239456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-532c4349-e9d4-4acf-b3e5-5d8dc9c83239 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:51.245068 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-532c4349-e9d4-4acf-b3e5-5d8dc9c83239 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:51.245503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-532c4349-e9d4-4acf-b3e5-5d8dc9c83239 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:51.246250 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-532c4349-e9d4-4acf-b3e5-5d8dc9c83239 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:51.246674 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-532c4349-e9d4-4acf-b3e5-5d8dc9c83239 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:51.363325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-532c4349-e9d4-4acf-b3e5-5d8dc9c83239 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:51.370927 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-532c4349-e9d4-4acf-b3e5-5d8dc9c83239 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.135786 Aug 19 09:22:51.371512 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 427/899] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:51 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:51.409015 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-dcbdc64a-9390-4460-973e-381305cc4a70 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:51.409617 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-dcbdc64a-9390-4460-973e-381305cc4a70 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:51.415531 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcbdc64a-9390-4460-973e-381305cc4a70 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:51.415972 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcbdc64a-9390-4460-973e-381305cc4a70 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:51.416724 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcbdc64a-9390-4460-973e-381305cc4a70 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:51.417148 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcbdc64a-9390-4460-973e-381305cc4a70 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:51.536027 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dcbdc64a-9390-4460-973e-381305cc4a70 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:51.544388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dcbdc64a-9390-4460-973e-381305cc4a70 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:51.545874 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dcbdc64a-9390-4460-973e-381305cc4a70 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:51.546997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-dcbdc64a-9390-4460-973e-381305cc4a70 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.141488 Aug 19 09:22:51.547587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 428/900] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:51 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:52.388459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-091fd8b4-d983-42d6-a56e-74b9c0730f6a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:52.389138 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-091fd8b4-d983-42d6-a56e-74b9c0730f6a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:52.394814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-091fd8b4-d983-42d6-a56e-74b9c0730f6a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:52.395283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-091fd8b4-d983-42d6-a56e-74b9c0730f6a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:52.396042 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-091fd8b4-d983-42d6-a56e-74b9c0730f6a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:52.396455 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-091fd8b4-d983-42d6-a56e-74b9c0730f6a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:52.523191 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-091fd8b4-d983-42d6-a56e-74b9c0730f6a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:52.530922 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-091fd8b4-d983-42d6-a56e-74b9c0730f6a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.146429 Aug 19 09:22:52.531589 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 429/901] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:52 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:52.565318 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2d7f973c-c092-43b4-8d5c-bb4c9a048cc2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:52.566203 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2d7f973c-c092-43b4-8d5c-bb4c9a048cc2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:52.573318 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2d7f973c-c092-43b4-8d5c-bb4c9a048cc2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:52.573769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2d7f973c-c092-43b4-8d5c-bb4c9a048cc2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:52.574555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2d7f973c-c092-43b4-8d5c-bb4c9a048cc2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:52.574988 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2d7f973c-c092-43b4-8d5c-bb4c9a048cc2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:52.698420 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2d7f973c-c092-43b4-8d5c-bb4c9a048cc2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:52.706961 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2d7f973c-c092-43b4-8d5c-bb4c9a048cc2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:52.708637 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2d7f973c-c092-43b4-8d5c-bb4c9a048cc2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:52.709871 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2d7f973c-c092-43b4-8d5c-bb4c9a048cc2 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.148167 Aug 19 09:22:52.720872 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 430/902] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:52 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:53.549606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-adca6526-bf4e-4fbe-8e03-7c3e9f6655ac tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:53.550242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-adca6526-bf4e-4fbe-8e03-7c3e9f6655ac tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:53.556958 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-adca6526-bf4e-4fbe-8e03-7c3e9f6655ac tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:53.557408 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-adca6526-bf4e-4fbe-8e03-7c3e9f6655ac tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:53.558177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-adca6526-bf4e-4fbe-8e03-7c3e9f6655ac tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:53.558615 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-adca6526-bf4e-4fbe-8e03-7c3e9f6655ac tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:53.676271 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-adca6526-bf4e-4fbe-8e03-7c3e9f6655ac tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:53.684135 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-adca6526-bf4e-4fbe-8e03-7c3e9f6655ac tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.138176 Aug 19 09:22:53.684709 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 431/903] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:53 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:53.731450 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-582db211-93e0-4d10-95cd-04a285a11bcb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:53.732432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-582db211-93e0-4d10-95cd-04a285a11bcb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:53.739441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-582db211-93e0-4d10-95cd-04a285a11bcb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:53.740021 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-582db211-93e0-4d10-95cd-04a285a11bcb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:53.740808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-582db211-93e0-4d10-95cd-04a285a11bcb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:53.741248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-582db211-93e0-4d10-95cd-04a285a11bcb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:53.869504 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-582db211-93e0-4d10-95cd-04a285a11bcb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:53.877563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-582db211-93e0-4d10-95cd-04a285a11bcb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:53.879070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-582db211-93e0-4d10-95cd-04a285a11bcb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:53.880244 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-582db211-93e0-4d10-95cd-04a285a11bcb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.154272 Aug 19 09:22:53.880804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 432/904] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:53 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:54.700551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e1b8dd72-a307-4df0-875a-f06a6c6fec0b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:54.702179 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e1b8dd72-a307-4df0-875a-f06a6c6fec0b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:54.709229 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e1b8dd72-a307-4df0-875a-f06a6c6fec0b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:54.710191 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e1b8dd72-a307-4df0-875a-f06a6c6fec0b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:54.711359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e1b8dd72-a307-4df0-875a-f06a6c6fec0b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:54.712098 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e1b8dd72-a307-4df0-875a-f06a6c6fec0b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:54.833215 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e1b8dd72-a307-4df0-875a-f06a6c6fec0b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:54.840364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e1b8dd72-a307-4df0-875a-f06a6c6fec0b tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.143751 Aug 19 09:22:54.840927 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 433/905] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:54 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:54.898544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-16ef29bd-cd29-4b45-bed0-0ee5a4b3bc3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:54.899149 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-16ef29bd-cd29-4b45-bed0-0ee5a4b3bc3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:54.905002 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16ef29bd-cd29-4b45-bed0-0ee5a4b3bc3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:54.905397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16ef29bd-cd29-4b45-bed0-0ee5a4b3bc3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:54.906154 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16ef29bd-cd29-4b45-bed0-0ee5a4b3bc3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:54.906585 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-16ef29bd-cd29-4b45-bed0-0ee5a4b3bc3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:55.027631 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-16ef29bd-cd29-4b45-bed0-0ee5a4b3bc3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:55.035675 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-16ef29bd-cd29-4b45-bed0-0ee5a4b3bc3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:55.037153 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-16ef29bd-cd29-4b45-bed0-0ee5a4b3bc3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:55.038284 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-16ef29bd-cd29-4b45-bed0-0ee5a4b3bc3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.143472 Aug 19 09:22:55.038843 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 434/906] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:54 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:55.857386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ef3b2211-74b0-4fad-804d-b31de5bed769 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:55.858756 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ef3b2211-74b0-4fad-804d-b31de5bed769 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:55.864576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef3b2211-74b0-4fad-804d-b31de5bed769 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:55.865017 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef3b2211-74b0-4fad-804d-b31de5bed769 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:55.865944 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef3b2211-74b0-4fad-804d-b31de5bed769 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:55.866374 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef3b2211-74b0-4fad-804d-b31de5bed769 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:55.994232 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ef3b2211-74b0-4fad-804d-b31de5bed769 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:56.001691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ef3b2211-74b0-4fad-804d-b31de5bed769 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.147919 Aug 19 09:22:56.002559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 435/907] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:55 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:56.056913 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bfa3c525-d2b2-419a-b884-e171c67e7eee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:56.057512 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bfa3c525-d2b2-419a-b884-e171c67e7eee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:56.063356 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bfa3c525-d2b2-419a-b884-e171c67e7eee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:56.063804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bfa3c525-d2b2-419a-b884-e171c67e7eee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:56.064554 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bfa3c525-d2b2-419a-b884-e171c67e7eee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:56.064980 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bfa3c525-d2b2-419a-b884-e171c67e7eee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:56.188186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bfa3c525-d2b2-419a-b884-e171c67e7eee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:56.196183 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bfa3c525-d2b2-419a-b884-e171c67e7eee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:56.198333 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bfa3c525-d2b2-419a-b884-e171c67e7eee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:56.199523 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bfa3c525-d2b2-419a-b884-e171c67e7eee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.146784 Aug 19 09:22:56.200070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 436/908] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:56 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:57.019063 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e22c799f-6cf3-4223-9034-75c2e0529e1e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:57.019758 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e22c799f-6cf3-4223-9034-75c2e0529e1e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:57.025755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e22c799f-6cf3-4223-9034-75c2e0529e1e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:57.026222 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e22c799f-6cf3-4223-9034-75c2e0529e1e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:57.027076 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e22c799f-6cf3-4223-9034-75c2e0529e1e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:57.028668 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e22c799f-6cf3-4223-9034-75c2e0529e1e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:57.171248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e22c799f-6cf3-4223-9034-75c2e0529e1e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:57.183387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e22c799f-6cf3-4223-9034-75c2e0529e1e tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.163752 Aug 19 09:22:57.184071 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 437/909] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:57 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:57.219043 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9eec8574-4e5a-4871-b64b-6c9e343e4621 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:57.219994 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9eec8574-4e5a-4871-b64b-6c9e343e4621 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:57.226445 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9eec8574-4e5a-4871-b64b-6c9e343e4621 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:57.226894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9eec8574-4e5a-4871-b64b-6c9e343e4621 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:57.227708 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9eec8574-4e5a-4871-b64b-6c9e343e4621 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:57.228752 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9eec8574-4e5a-4871-b64b-6c9e343e4621 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:57.368373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9eec8574-4e5a-4871-b64b-6c9e343e4621 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:57.377540 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9eec8574-4e5a-4871-b64b-6c9e343e4621 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:57.379309 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9eec8574-4e5a-4871-b64b-6c9e343e4621 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:57.380950 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9eec8574-4e5a-4871-b64b-6c9e343e4621 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.166309 Aug 19 09:22:57.381952 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 438/910] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:57 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:22:58.200127 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0e5d6c49-f025-4e29-8645-65e0969b98af tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:58.200916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0e5d6c49-f025-4e29-8645-65e0969b98af tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:58.206491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0e5d6c49-f025-4e29-8645-65e0969b98af tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:58.206932 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0e5d6c49-f025-4e29-8645-65e0969b98af tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:58.207716 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0e5d6c49-f025-4e29-8645-65e0969b98af tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:58.208147 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0e5d6c49-f025-4e29-8645-65e0969b98af tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:58.332872 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0e5d6c49-f025-4e29-8645-65e0969b98af tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:58.341999 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0e5d6c49-f025-4e29-8645-65e0969b98af tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.146284 Aug 19 09:22:58.353952 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 439/911] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:58 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:58.398934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d97c6e26-8425-4048-836f-ef81ecc295b1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:58.399574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d97c6e26-8425-4048-836f-ef81ecc295b1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:58.405828 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d97c6e26-8425-4048-836f-ef81ecc295b1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:58.406239 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d97c6e26-8425-4048-836f-ef81ecc295b1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:58.407074 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d97c6e26-8425-4048-836f-ef81ecc295b1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:58.407575 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d97c6e26-8425-4048-836f-ef81ecc295b1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:58.550193 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d97c6e26-8425-4048-836f-ef81ecc295b1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:58.559494 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d97c6e26-8425-4048-836f-ef81ecc295b1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:58.560557 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d97c6e26-8425-4048-836f-ef81ecc295b1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:58.561822 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d97c6e26-8425-4048-836f-ef81ecc295b1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.166538 Aug 19 09:22:58.563330 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 440/912] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:58 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:22:59.361264 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4626cf0d-4a63-4af1-b4af-a3a1c301539a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:59.362004 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4626cf0d-4a63-4af1-b4af-a3a1c301539a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:59.368237 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4626cf0d-4a63-4af1-b4af-a3a1c301539a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:59.369457 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4626cf0d-4a63-4af1-b4af-a3a1c301539a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:59.370318 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4626cf0d-4a63-4af1-b4af-a3a1c301539a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:59.370825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4626cf0d-4a63-4af1-b4af-a3a1c301539a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:59.504551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4626cf0d-4a63-4af1-b4af-a3a1c301539a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:59.514222 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4626cf0d-4a63-4af1-b4af-a3a1c301539a tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.156732 Aug 19 09:22:59.515023 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 441/913] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:22:59 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:22:59.587847 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7b372090-13c2-44c5-88ca-1493cd39ef65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:22:59.588909 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7b372090-13c2-44c5-88ca-1493cd39ef65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:22:59.596340 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b372090-13c2-44c5-88ca-1493cd39ef65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:59.597152 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b372090-13c2-44c5-88ca-1493cd39ef65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:59.598184 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b372090-13c2-44c5-88ca-1493cd39ef65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:22:59.599089 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b372090-13c2-44c5-88ca-1493cd39ef65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:22:59.732723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7b372090-13c2-44c5-88ca-1493cd39ef65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:59.740785 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7b372090-13c2-44c5-88ca-1493cd39ef65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:59.742398 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7b372090-13c2-44c5-88ca-1493cd39ef65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:22:59.743630 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7b372090-13c2-44c5-88ca-1493cd39ef65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.159982 Aug 19 09:22:59.748646 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 442/914] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:22:59 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:00.531337 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c524bf4b-ca44-4f2b-af9c-28a8a5917a0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:00.532047 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c524bf4b-ca44-4f2b-af9c-28a8a5917a0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:00.539807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c524bf4b-ca44-4f2b-af9c-28a8a5917a0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:00.540520 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c524bf4b-ca44-4f2b-af9c-28a8a5917a0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:00.541492 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c524bf4b-ca44-4f2b-af9c-28a8a5917a0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:00.542484 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c524bf4b-ca44-4f2b-af9c-28a8a5917a0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:00.677258 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c524bf4b-ca44-4f2b-af9c-28a8a5917a0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:00.687325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c524bf4b-ca44-4f2b-af9c-28a8a5917a0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.159301 Aug 19 09:23:00.687881 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 443/915] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:00 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:00.761967 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-51530d85-0011-4b39-a6be-f4def4b8e68e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:00.762581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-51530d85-0011-4b39-a6be-f4def4b8e68e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:00.768340 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51530d85-0011-4b39-a6be-f4def4b8e68e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:00.768785 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51530d85-0011-4b39-a6be-f4def4b8e68e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:00.769559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51530d85-0011-4b39-a6be-f4def4b8e68e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:00.769997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51530d85-0011-4b39-a6be-f4def4b8e68e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:00.891651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-51530d85-0011-4b39-a6be-f4def4b8e68e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:00.899957 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-51530d85-0011-4b39-a6be-f4def4b8e68e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:00.901444 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-51530d85-0011-4b39-a6be-f4def4b8e68e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:00.902580 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-51530d85-0011-4b39-a6be-f4def4b8e68e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.144624 Aug 19 09:23:00.903136 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 444/916] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:00 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:01.703972 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9160b8f5-9827-4405-b52e-36e18e67eb9c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:01.704581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9160b8f5-9827-4405-b52e-36e18e67eb9c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:01.710853 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9160b8f5-9827-4405-b52e-36e18e67eb9c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:01.711341 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9160b8f5-9827-4405-b52e-36e18e67eb9c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:01.712758 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9160b8f5-9827-4405-b52e-36e18e67eb9c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:01.713207 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9160b8f5-9827-4405-b52e-36e18e67eb9c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:01.843157 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9160b8f5-9827-4405-b52e-36e18e67eb9c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:01.850647 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9160b8f5-9827-4405-b52e-36e18e67eb9c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.150288 Aug 19 09:23:01.851211 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 445/917] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:01 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:23:01.921537 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-51fdd7ff-f362-436d-a70f-84e8613eda6d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:01.922142 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-51fdd7ff-f362-436d-a70f-84e8613eda6d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:01.927748 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51fdd7ff-f362-436d-a70f-84e8613eda6d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:01.928245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51fdd7ff-f362-436d-a70f-84e8613eda6d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:01.928933 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51fdd7ff-f362-436d-a70f-84e8613eda6d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:01.929359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-51fdd7ff-f362-436d-a70f-84e8613eda6d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:02.056358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-51fdd7ff-f362-436d-a70f-84e8613eda6d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:02.064979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-51fdd7ff-f362-436d-a70f-84e8613eda6d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:02.066477 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-51fdd7ff-f362-436d-a70f-84e8613eda6d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:02.067723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-51fdd7ff-f362-436d-a70f-84e8613eda6d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.149814 Aug 19 09:23:02.068281 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 446/918] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:01 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:02.218144 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4011fa5d-0043-4bcc-af5b-8c287610fdf0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28193 microversion: 2.1 time: 16.915754 Aug 19 09:23:02.219087 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 473/919] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:22:45 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28193 bytes in 16917 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:02.867852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-72b48554-e8a4-4380-861a-2d3a507c7e21 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:02.869673 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-72b48554-e8a4-4380-861a-2d3a507c7e21 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:02.875563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-72b48554-e8a4-4380-861a-2d3a507c7e21 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:02.876011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-72b48554-e8a4-4380-861a-2d3a507c7e21 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:02.876781 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-72b48554-e8a4-4380-861a-2d3a507c7e21 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:02.877220 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-72b48554-e8a4-4380-861a-2d3a507c7e21 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:03.034054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-72b48554-e8a4-4380-861a-2d3a507c7e21 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:03.041983 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-72b48554-e8a4-4380-861a-2d3a507c7e21 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.177908 Aug 19 09:23:03.042546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 447/920] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:02 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:03.086239 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-45f751ed-358f-44b5-91e8-4729f896b541 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:03.087595 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-45f751ed-358f-44b5-91e8-4729f896b541 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:03.094728 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45f751ed-358f-44b5-91e8-4729f896b541 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:03.095404 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45f751ed-358f-44b5-91e8-4729f896b541 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:03.096175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45f751ed-358f-44b5-91e8-4729f896b541 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:03.096608 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45f751ed-358f-44b5-91e8-4729f896b541 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:03.230227 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-45f751ed-358f-44b5-91e8-4729f896b541 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:03.230848 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2e7fd5d7-cb73-4369-9a34-a9913f6676cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:03.231382 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2e7fd5d7-cb73-4369-9a34-a9913f6676cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:03.237140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2e7fd5d7-cb73-4369-9a34-a9913f6676cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:03.237587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2e7fd5d7-cb73-4369-9a34-a9913f6676cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:03.238342 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2e7fd5d7-cb73-4369-9a34-a9913f6676cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:03.238770 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2e7fd5d7-cb73-4369-9a34-a9913f6676cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:03.239380 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-45f751ed-358f-44b5-91e8-4729f896b541 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:03.240991 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-45f751ed-358f-44b5-91e8-4729f896b541 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:03.243015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-45f751ed-358f-44b5-91e8-4729f896b541 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.160074 Aug 19 09:23:03.243015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 474/921] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:03 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:23:03.323780 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2e7fd5d7-cb73-4369-9a34-a9913f6676cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28193 microversion: 2.1 time: 0.097468 Aug 19 09:23:03.327842 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 448/922] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:03 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:23:04.058958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cd7fd4ad-d6c1-48a7-9744-4ef8b8a1cf64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:04.059737 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cd7fd4ad-d6c1-48a7-9744-4ef8b8a1cf64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:04.065433 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cd7fd4ad-d6c1-48a7-9744-4ef8b8a1cf64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:04.065897 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cd7fd4ad-d6c1-48a7-9744-4ef8b8a1cf64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:04.066663 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cd7fd4ad-d6c1-48a7-9744-4ef8b8a1cf64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:04.067098 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cd7fd4ad-d6c1-48a7-9744-4ef8b8a1cf64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:04.199823 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cd7fd4ad-d6c1-48a7-9744-4ef8b8a1cf64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:04.208043 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cd7fd4ad-d6c1-48a7-9744-4ef8b8a1cf64 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 200 len: 1514 microversion: 2.1 time: 0.152796 Aug 19 09:23:04.208607 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 475/923] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:04 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:04.261402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-30a5f367-f4ce-4565-aa6a-9f25c1404213 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:04.262147 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-30a5f367-f4ce-4565-aa6a-9f25c1404213 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:04.268475 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30a5f367-f4ce-4565-aa6a-9f25c1404213 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:04.268925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30a5f367-f4ce-4565-aa6a-9f25c1404213 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:04.269821 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30a5f367-f4ce-4565-aa6a-9f25c1404213 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:04.270258 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-30a5f367-f4ce-4565-aa6a-9f25c1404213 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:04.335164 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-202eaa2c-e7bc-4e17-969b-6dd0659437c6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:04.336698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-202eaa2c-e7bc-4e17-969b-6dd0659437c6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:04.342908 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-202eaa2c-e7bc-4e17-969b-6dd0659437c6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:04.343398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-202eaa2c-e7bc-4e17-969b-6dd0659437c6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:04.344203 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-202eaa2c-e7bc-4e17-969b-6dd0659437c6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:04.344606 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-202eaa2c-e7bc-4e17-969b-6dd0659437c6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:04.433896 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-202eaa2c-e7bc-4e17-969b-6dd0659437c6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28193 microversion: 2.1 time: 0.102297 Aug 19 09:23:04.437153 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 476/924] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:04 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28193 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:23:04.481492 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-30a5f367-f4ce-4565-aa6a-9f25c1404213 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:04.489729 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-30a5f367-f4ce-4565-aa6a-9f25c1404213 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:04.491247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-30a5f367-f4ce-4565-aa6a-9f25c1404213 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:04.492423 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-30a5f367-f4ce-4565-aa6a-9f25c1404213 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.235721 Aug 19 09:23:04.492969 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 449/925] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:04 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:23:04.851420 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-6801ac48-569a-4a20-a660-e6f609db4703 req-14fbfbfd-0c9d-40f8-9ecf-31e1f79a4e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db6043f-4b5d-4736-9623-cc4a3220ba35", "name": "network-vif-deleted", "tag": "a57e9f7c-c1f7-45a1-a64e-e8297bcf8c36"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:04.853048 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:23:04.853048 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:23:04.859939 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-6801ac48-569a-4a20-a660-e6f609db4703 req-14fbfbfd-0c9d-40f8-9ecf-31e1f79a4e50 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:04.860367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-6801ac48-569a-4a20-a660-e6f609db4703 req-14fbfbfd-0c9d-40f8-9ecf-31e1f79a4e50 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:04.872644 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-6801ac48-569a-4a20-a660-e6f609db4703 req-14fbfbfd-0c9d-40f8-9ecf-31e1f79a4e50 service nova] Creating event network-vif-deleted:a57e9f7c-c1f7-45a1-a64e-e8297bcf8c36 for instance 2db6043f-4b5d-4736-9623-cc4a3220ba35 on hv-cinder-77387 Aug 19 09:23:04.877537 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-6801ac48-569a-4a20-a660-e6f609db4703 req-14fbfbfd-0c9d-40f8-9ecf-31e1f79a4e50 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217577 Aug 19 09:23:04.878125 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 477/926] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:23:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:23:05.225372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-171b95d3-a94b-4605-9741-749ec2c690d3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:05.226057 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-171b95d3-a94b-4605-9741-749ec2c690d3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 2db6043f-4b5d-4736-9623-cc4a3220ba35] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:05.232357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-171b95d3-a94b-4605-9741-749ec2c690d3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:05.232798 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-171b95d3-a94b-4605-9741-749ec2c690d3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:05.233614 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-171b95d3-a94b-4605-9741-749ec2c690d3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:05.234076 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-171b95d3-a94b-4605-9741-749ec2c690d3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:05.248885 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-171b95d3-a94b-4605-9741-749ec2c690d3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] HTTP exception thrown: Instance 2db6043f-4b5d-4736-9623-cc4a3220ba35 could not be found. Aug 19 09:23:05.249473 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-171b95d3-a94b-4605-9741-749ec2c690d3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Returning 404 to user: Instance 2db6043f-4b5d-4736-9623-cc4a3220ba35 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:23:05.250301 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-171b95d3-a94b-4605-9741-749ec2c690d3 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35" status: 404 len: 111 microversion: 2.1 time: 0.029137 Aug 19 09:23:05.250843 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 450/927] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:05 2021] GET /compute/v2.1/servers/2db6043f-4b5d-4736-9623-cc4a3220ba35 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:23:05.445042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8f698502-fd9c-427c-8568-ccdec62fd347 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:05.446028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8f698502-fd9c-427c-8568-ccdec62fd347 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:05.452052 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f698502-fd9c-427c-8568-ccdec62fd347 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:05.452567 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f698502-fd9c-427c-8568-ccdec62fd347 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:05.453378 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f698502-fd9c-427c-8568-ccdec62fd347 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:05.453878 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f698502-fd9c-427c-8568-ccdec62fd347 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:05.511857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4aaa5e57-4c3a-4e22-a219-9c47830b74b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:05.512503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4aaa5e57-4c3a-4e22-a219-9c47830b74b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:05.518653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4aaa5e57-4c3a-4e22-a219-9c47830b74b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:05.519094 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4aaa5e57-4c3a-4e22-a219-9c47830b74b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:05.520008 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4aaa5e57-4c3a-4e22-a219-9c47830b74b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:05.520446 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4aaa5e57-4c3a-4e22-a219-9c47830b74b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:05.548919 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8f698502-fd9c-427c-8568-ccdec62fd347 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28193 microversion: 2.1 time: 0.107625 Aug 19 09:23:05.551389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 478/928] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:05 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:05.643076 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4aaa5e57-4c3a-4e22-a219-9c47830b74b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:05.652077 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4aaa5e57-4c3a-4e22-a219-9c47830b74b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:05.653575 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4aaa5e57-4c3a-4e22-a219-9c47830b74b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:05.654745 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4aaa5e57-4c3a-4e22-a219-9c47830b74b7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.147279 Aug 19 09:23:05.655316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 451/929] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:05 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:06.560216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f88e21a2-ca08-49f8-86e4-c1405f163adc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:06.561221 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f88e21a2-ca08-49f8-86e4-c1405f163adc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:06.567612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f88e21a2-ca08-49f8-86e4-c1405f163adc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:06.568049 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f88e21a2-ca08-49f8-86e4-c1405f163adc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:06.568798 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f88e21a2-ca08-49f8-86e4-c1405f163adc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:06.569223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f88e21a2-ca08-49f8-86e4-c1405f163adc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:06.672555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b6395d8b-b266-428f-ae77-cc54f08eb112 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:06.673161 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b6395d8b-b266-428f-ae77-cc54f08eb112 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:06.678788 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b6395d8b-b266-428f-ae77-cc54f08eb112 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:06.679230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b6395d8b-b266-428f-ae77-cc54f08eb112 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:06.680022 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b6395d8b-b266-428f-ae77-cc54f08eb112 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:06.680451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b6395d8b-b266-428f-ae77-cc54f08eb112 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:06.801331 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b6395d8b-b266-428f-ae77-cc54f08eb112 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:06.810667 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b6395d8b-b266-428f-ae77-cc54f08eb112 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:06.812197 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b6395d8b-b266-428f-ae77-cc54f08eb112 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:06.813360 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b6395d8b-b266-428f-ae77-cc54f08eb112 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.144462 Aug 19 09:23:06.813915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 452/930] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:06 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:07.831987 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f04e07e1-4046-4f09-b66d-b8de849a7e88 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:07.832597 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f04e07e1-4046-4f09-b66d-b8de849a7e88 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:07.839362 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f04e07e1-4046-4f09-b66d-b8de849a7e88 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:07.839807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f04e07e1-4046-4f09-b66d-b8de849a7e88 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:07.840556 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f04e07e1-4046-4f09-b66d-b8de849a7e88 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:07.840990 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f04e07e1-4046-4f09-b66d-b8de849a7e88 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:07.957069 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f04e07e1-4046-4f09-b66d-b8de849a7e88 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:07.965596 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f04e07e1-4046-4f09-b66d-b8de849a7e88 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:07.967078 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f04e07e1-4046-4f09-b66d-b8de849a7e88 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:07.968233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f04e07e1-4046-4f09-b66d-b8de849a7e88 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.140021 Aug 19 09:23:07.968778 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 453/931] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:07 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:08.986277 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3cd9fdeb-1098-414c-9717-0330e270710e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:08.986895 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3cd9fdeb-1098-414c-9717-0330e270710e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:08.992609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cd9fdeb-1098-414c-9717-0330e270710e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:08.993053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cd9fdeb-1098-414c-9717-0330e270710e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:08.993843 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cd9fdeb-1098-414c-9717-0330e270710e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:08.994522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cd9fdeb-1098-414c-9717-0330e270710e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:09.119162 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3cd9fdeb-1098-414c-9717-0330e270710e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:09.127139 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3cd9fdeb-1098-414c-9717-0330e270710e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:09.128643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3cd9fdeb-1098-414c-9717-0330e270710e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:09.129765 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3cd9fdeb-1098-414c-9717-0330e270710e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.147157 Aug 19 09:23:09.130307 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 454/932] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:08 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:10.147609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-99c7d8ca-c7f1-4b6f-8498-9c06204d0c6c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:10.148227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-99c7d8ca-c7f1-4b6f-8498-9c06204d0c6c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:10.154569 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99c7d8ca-c7f1-4b6f-8498-9c06204d0c6c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:10.155010 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99c7d8ca-c7f1-4b6f-8498-9c06204d0c6c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:10.155794 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99c7d8ca-c7f1-4b6f-8498-9c06204d0c6c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:10.156228 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99c7d8ca-c7f1-4b6f-8498-9c06204d0c6c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:10.274140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-99c7d8ca-c7f1-4b6f-8498-9c06204d0c6c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:10.280461 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f88e21a2-ca08-49f8-86e4-c1405f163adc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28193 microversion: 2.1 time: 3.724104 Aug 19 09:23:10.281820 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 479/933] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:06 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28193 bytes in 3726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:10.283131 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-99c7d8ca-c7f1-4b6f-8498-9c06204d0c6c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:10.284701 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-99c7d8ca-c7f1-4b6f-8498-9c06204d0c6c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:10.285852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-99c7d8ca-c7f1-4b6f-8498-9c06204d0c6c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.141930 Aug 19 09:23:10.286396 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 455/934] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:10 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:11.294622 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4f1585d0-50bf-440e-805f-64752325fc40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:11.295577 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4f1585d0-50bf-440e-805f-64752325fc40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:11.301958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4f1585d0-50bf-440e-805f-64752325fc40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:11.302405 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4f1585d0-50bf-440e-805f-64752325fc40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:11.303174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4f1585d0-50bf-440e-805f-64752325fc40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:11.303350 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0b970050-c9ea-418d-bd21-030fd2d8d646 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:11.303759 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4f1585d0-50bf-440e-805f-64752325fc40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:11.303920 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0b970050-c9ea-418d-bd21-030fd2d8d646 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:11.309992 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b970050-c9ea-418d-bd21-030fd2d8d646 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:11.310435 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b970050-c9ea-418d-bd21-030fd2d8d646 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:11.311188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b970050-c9ea-418d-bd21-030fd2d8d646 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:11.311807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b970050-c9ea-418d-bd21-030fd2d8d646 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:11.395940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4f1585d0-50bf-440e-805f-64752325fc40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28484 microversion: 2.1 time: 0.105990 Aug 19 09:23:11.396592 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 480/935] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:11 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28484 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:11.440965 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0b970050-c9ea-418d-bd21-030fd2d8d646 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:11.449284 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0b970050-c9ea-418d-bd21-030fd2d8d646 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:11.450775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0b970050-c9ea-418d-bd21-030fd2d8d646 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:11.451972 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0b970050-c9ea-418d-bd21-030fd2d8d646 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.152295 Aug 19 09:23:11.452553 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 456/936] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:11 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:23:12.414053 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c8ac737a-17f6-4b24-9a64-cea1d4c01074 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:12.416196 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c8ac737a-17f6-4b24-9a64-cea1d4c01074 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:12.423842 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c8ac737a-17f6-4b24-9a64-cea1d4c01074 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:12.424291 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c8ac737a-17f6-4b24-9a64-cea1d4c01074 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:12.425059 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c8ac737a-17f6-4b24-9a64-cea1d4c01074 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:12.425474 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c8ac737a-17f6-4b24-9a64-cea1d4c01074 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:12.470495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3e87d92b-6734-423c-8c0b-34c77b04455c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:12.471866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3e87d92b-6734-423c-8c0b-34c77b04455c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:12.478994 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3e87d92b-6734-423c-8c0b-34c77b04455c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:12.479563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3e87d92b-6734-423c-8c0b-34c77b04455c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:12.480409 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3e87d92b-6734-423c-8c0b-34c77b04455c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:12.480916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3e87d92b-6734-423c-8c0b-34c77b04455c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:12.630612 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3e87d92b-6734-423c-8c0b-34c77b04455c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:12.639702 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3e87d92b-6734-423c-8c0b-34c77b04455c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:12.641201 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3e87d92b-6734-423c-8c0b-34c77b04455c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:12.642374 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3e87d92b-6734-423c-8c0b-34c77b04455c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.175636 Aug 19 09:23:12.643116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 457/937] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:12 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:13.660245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-20ebfa6f-5eaa-4a6e-ae86-bc12cbf9748d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:13.660856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-20ebfa6f-5eaa-4a6e-ae86-bc12cbf9748d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:13.666719 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20ebfa6f-5eaa-4a6e-ae86-bc12cbf9748d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:13.667164 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20ebfa6f-5eaa-4a6e-ae86-bc12cbf9748d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:13.667956 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20ebfa6f-5eaa-4a6e-ae86-bc12cbf9748d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:13.668386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20ebfa6f-5eaa-4a6e-ae86-bc12cbf9748d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:13.792579 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-20ebfa6f-5eaa-4a6e-ae86-bc12cbf9748d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:13.800740 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-20ebfa6f-5eaa-4a6e-ae86-bc12cbf9748d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:13.802223 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-20ebfa6f-5eaa-4a6e-ae86-bc12cbf9748d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:13.803386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-20ebfa6f-5eaa-4a6e-ae86-bc12cbf9748d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.146845 Aug 19 09:23:13.803941 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 458/938] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:13 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:14.822981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3ee4beba-03e6-47b8-8db8-04fe998aec3a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:14.823639 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3ee4beba-03e6-47b8-8db8-04fe998aec3a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:14.829315 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3ee4beba-03e6-47b8-8db8-04fe998aec3a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:14.829766 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3ee4beba-03e6-47b8-8db8-04fe998aec3a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:14.830526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3ee4beba-03e6-47b8-8db8-04fe998aec3a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:14.830957 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3ee4beba-03e6-47b8-8db8-04fe998aec3a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:14.951191 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3ee4beba-03e6-47b8-8db8-04fe998aec3a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:14.959428 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3ee4beba-03e6-47b8-8db8-04fe998aec3a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:14.960919 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3ee4beba-03e6-47b8-8db8-04fe998aec3a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:14.962150 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3ee4beba-03e6-47b8-8db8-04fe998aec3a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.143534 Aug 19 09:23:14.962579 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 459/939] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:14 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:23:15.737349 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c8ac737a-17f6-4b24-9a64-cea1d4c01074 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28484 microversion: 2.1 time: 3.332986 Aug 19 09:23:15.738001 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 481/940] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:12 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28484 bytes in 3335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:15.981563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-43845a20-a927-4355-88d8-956689701781 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:15.982109 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-43845a20-a927-4355-88d8-956689701781 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:15.988159 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-43845a20-a927-4355-88d8-956689701781 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:15.988619 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-43845a20-a927-4355-88d8-956689701781 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:15.989387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-43845a20-a927-4355-88d8-956689701781 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:15.989824 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-43845a20-a927-4355-88d8-956689701781 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:16.110313 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-43845a20-a927-4355-88d8-956689701781 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:16.118397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-43845a20-a927-4355-88d8-956689701781 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:16.119939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-43845a20-a927-4355-88d8-956689701781 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:16.121075 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-43845a20-a927-4355-88d8-956689701781 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.144004 Aug 19 09:23:16.121628 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 460/941] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:15 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:23:16.750373 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-86c52b43-fbdb-4bce-b8b6-99701af81dac tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:16.751336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-86c52b43-fbdb-4bce-b8b6-99701af81dac tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:16.757829 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-86c52b43-fbdb-4bce-b8b6-99701af81dac tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:16.758275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-86c52b43-fbdb-4bce-b8b6-99701af81dac tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:16.759070 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-86c52b43-fbdb-4bce-b8b6-99701af81dac tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:16.759541 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-86c52b43-fbdb-4bce-b8b6-99701af81dac tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:16.864855 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-86c52b43-fbdb-4bce-b8b6-99701af81dac tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.118446 Aug 19 09:23:16.869299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 482/942] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:16 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:17.126351 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1703149985", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "networks": [{"uuid": "2cdad480-ecf1-480c-be1b-4e9459f44f51"}]}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:17.141209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-76837c5b-2ea6-4a7c-b15f-98f2d57ea2d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:17.142200 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-76837c5b-2ea6-4a7c-b15f-98f2d57ea2d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:17.152708 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-76837c5b-2ea6-4a7c-b15f-98f2d57ea2d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:17.153190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-76837c5b-2ea6-4a7c-b15f-98f2d57ea2d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:17.154218 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-76837c5b-2ea6-4a7c-b15f-98f2d57ea2d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:17.154656 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-76837c5b-2ea6-4a7c-b15f-98f2d57ea2d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:17.179024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] validate_networks() for [('2cdad480-ecf1-480c-be1b-4e9459f44f51', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:23:17.277983 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-76837c5b-2ea6-4a7c-b15f-98f2d57ea2d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:17.286289 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-76837c5b-2ea6-4a7c-b15f-98f2d57ea2d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:17.287871 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-76837c5b-2ea6-4a7c-b15f-98f2d57ea2d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:17.289015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-76837c5b-2ea6-4a7c-b15f-98f2d57ea2d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.151959 Aug 19 09:23:17.289598 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 483/943] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:17 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:23:17.608915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:23:17.609345 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:23:17.609840 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:23:17.610269 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:23:17.610676 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:23:17.619738 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:17.620182 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:17.620977 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:17.621410 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:17.637932 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Getting quotas for project ed982dbeb62c47f9b68eed4195a3e3a7. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:23:17.641775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Getting quotas for user c1ac96455c3e469d94469fcaf530290a and project ed982dbeb62c47f9b68eed4195a3e3a7. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:23:17.652419 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:23:17.654656 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:23:17.697568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bce8b75f-2f44-4228-9466-53a8261f6243 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574826 Aug 19 09:23:17.698211 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 461/944] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:23:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 19 09:23:17.708093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8f63acd6-b232-4c94-a98d-cecdce0ad077 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:17.708749 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8f63acd6-b232-4c94-a98d-cecdce0ad077 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:17.759058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8f63acd6-b232-4c94-a98d-cecdce0ad077 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:17.765570 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8f63acd6-b232-4c94-a98d-cecdce0ad077 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1219 microversion: 2.1 time: 0.061179 Aug 19 09:23:17.766258 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 484/945] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:17 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1219 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:17.878142 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-48432f93-fbca-48a6-9606-eb0cf568b30f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:17.879475 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-48432f93-fbca-48a6-9606-eb0cf568b30f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:17.886938 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-48432f93-fbca-48a6-9606-eb0cf568b30f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:17.887555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-48432f93-fbca-48a6-9606-eb0cf568b30f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:17.889753 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-48432f93-fbca-48a6-9606-eb0cf568b30f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:17.889753 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-48432f93-fbca-48a6-9606-eb0cf568b30f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:17.980952 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-48432f93-fbca-48a6-9606-eb0cf568b30f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.106928 Aug 19 09:23:17.981592 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 462/946] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:17 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:18.307245 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c178afc0-3085-461f-9e1c-4a8a7ff8edbb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:18.307884 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c178afc0-3085-461f-9e1c-4a8a7ff8edbb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:18.314133 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c178afc0-3085-461f-9e1c-4a8a7ff8edbb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:18.314487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c178afc0-3085-461f-9e1c-4a8a7ff8edbb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:18.315251 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c178afc0-3085-461f-9e1c-4a8a7ff8edbb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:18.315708 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c178afc0-3085-461f-9e1c-4a8a7ff8edbb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:18.453837 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c178afc0-3085-461f-9e1c-4a8a7ff8edbb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:18.462093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c178afc0-3085-461f-9e1c-4a8a7ff8edbb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:18.464038 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c178afc0-3085-461f-9e1c-4a8a7ff8edbb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:18.465169 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c178afc0-3085-461f-9e1c-4a8a7ff8edbb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.161891 Aug 19 09:23:18.465753 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 485/947] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:18 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:23:18.570309 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-4085ccd0-fd57-4947-91eb-d9fd33696e0a req-c9817528-025a-432d-af0b-c786f79d1d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed06d0a-7ee6-4f00-b470-b19d7331667c", "name": "network-vif-plugged", "status": "completed", "tag": "137293e7-3590-4eee-8e9a-b01076e25605"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:18.574709 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:23:18.574709 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:23:18.590421 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-4085ccd0-fd57-4947-91eb-d9fd33696e0a req-c9817528-025a-432d-af0b-c786f79d1d32 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:18.590861 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-4085ccd0-fd57-4947-91eb-d9fd33696e0a req-c9817528-025a-432d-af0b-c786f79d1d32 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:18.606269 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-4085ccd0-fd57-4947-91eb-d9fd33696e0a req-c9817528-025a-432d-af0b-c786f79d1d32 service nova] Creating event network-vif-plugged:137293e7-3590-4eee-8e9a-b01076e25605 for instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c on hv-cinder-77387 Aug 19 09:23:18.612840 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-4085ccd0-fd57-4947-91eb-d9fd33696e0a req-c9817528-025a-432d-af0b-c786f79d1d32 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047631 Aug 19 09:23:18.614991 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 463/948] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:23:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:23:18.786272 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0fd956d3-659a-45e6-a506-a312bc048506 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:18.788281 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0fd956d3-659a-45e6-a506-a312bc048506 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:18.800148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0fd956d3-659a-45e6-a506-a312bc048506 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:18.801459 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0fd956d3-659a-45e6-a506-a312bc048506 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:18.803040 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0fd956d3-659a-45e6-a506-a312bc048506 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:18.804086 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0fd956d3-659a-45e6-a506-a312bc048506 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:18.915020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0fd956d3-659a-45e6-a506-a312bc048506 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:18.924336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0fd956d3-659a-45e6-a506-a312bc048506 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1277 microversion: 2.1 time: 0.145172 Aug 19 09:23:18.925169 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 486/949] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:18 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:18.994463 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-07532d98-52c4-47be-8ffb-20bbdff8e512 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:18.995878 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-07532d98-52c4-47be-8ffb-20bbdff8e512 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:19.010933 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-07532d98-52c4-47be-8ffb-20bbdff8e512 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:19.013084 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-07532d98-52c4-47be-8ffb-20bbdff8e512 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:19.013950 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-07532d98-52c4-47be-8ffb-20bbdff8e512 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:19.014486 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-07532d98-52c4-47be-8ffb-20bbdff8e512 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:19.101922 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-07532d98-52c4-47be-8ffb-20bbdff8e512 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.112793 Aug 19 09:23:19.104686 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 464/950] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:18 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:23:19.486331 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-89d9da1c-8436-4353-ac0e-cf52b19f604f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:19.487253 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-89d9da1c-8436-4353-ac0e-cf52b19f604f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:19.495371 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89d9da1c-8436-4353-ac0e-cf52b19f604f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:19.495899 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89d9da1c-8436-4353-ac0e-cf52b19f604f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:19.496752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89d9da1c-8436-4353-ac0e-cf52b19f604f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:19.497422 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-89d9da1c-8436-4353-ac0e-cf52b19f604f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:19.688613 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-89d9da1c-8436-4353-ac0e-cf52b19f604f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:19.701004 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-89d9da1c-8436-4353-ac0e-cf52b19f604f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:19.702685 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-89d9da1c-8436-4353-ac0e-cf52b19f604f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:19.704141 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-89d9da1c-8436-4353-ac0e-cf52b19f604f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.222739 Aug 19 09:23:19.715843 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 487/951] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:19 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:23:19.943798 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e14f8ed6-616d-48a0-9736-c91af8e5a6ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:19.944612 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e14f8ed6-616d-48a0-9736-c91af8e5a6ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:19.951843 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e14f8ed6-616d-48a0-9736-c91af8e5a6ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:19.952418 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e14f8ed6-616d-48a0-9736-c91af8e5a6ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:19.953250 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e14f8ed6-616d-48a0-9736-c91af8e5a6ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:19.954088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e14f8ed6-616d-48a0-9736-c91af8e5a6ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:20.115681 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-de2ecd4e-cf4a-4de4-95e0-85e06b700bc0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:20.116993 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-de2ecd4e-cf4a-4de4-95e0-85e06b700bc0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:20.124135 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-de2ecd4e-cf4a-4de4-95e0-85e06b700bc0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:20.124555 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-de2ecd4e-cf4a-4de4-95e0-85e06b700bc0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:20.125595 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-de2ecd4e-cf4a-4de4-95e0-85e06b700bc0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:20.126115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-de2ecd4e-cf4a-4de4-95e0-85e06b700bc0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:20.157709 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e14f8ed6-616d-48a0-9736-c91af8e5a6ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:20.166102 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e14f8ed6-616d-48a0-9736-c91af8e5a6ec tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1319 microversion: 2.1 time: 0.225871 Aug 19 09:23:20.166810 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 465/952] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:19 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:20.255941 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-de2ecd4e-cf4a-4de4-95e0-85e06b700bc0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.143889 Aug 19 09:23:20.257480 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 488/953] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:20 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:23:20.483845 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-03cf590e-392a-4384-8bf1-892fd7e3f008 req-de35d7b3-ad9a-471b-8960-d1181858acea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0287d415-3c4d-439f-93f0-a11db16c282b", "tag": "6547a078-9434-436e-b393-e0a15dc6d5c6"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:20.485961 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:23:20.485961 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:23:20.494657 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-03cf590e-392a-4384-8bf1-892fd7e3f008 req-de35d7b3-ad9a-471b-8960-d1181858acea service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:20.495432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-03cf590e-392a-4384-8bf1-892fd7e3f008 req-de35d7b3-ad9a-471b-8960-d1181858acea service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:20.508221 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-03cf590e-392a-4384-8bf1-892fd7e3f008 req-de35d7b3-ad9a-471b-8960-d1181858acea service nova] Creating event network-changed:6547a078-9434-436e-b393-e0a15dc6d5c6 for instance 0287d415-3c4d-439f-93f0-a11db16c282b on hv-cinder-77387 Aug 19 09:23:20.514494 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-03cf590e-392a-4384-8bf1-892fd7e3f008 req-de35d7b3-ad9a-471b-8960-d1181858acea service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034248 Aug 19 09:23:20.515847 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 466/954] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:23:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:23:20.723168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-21157572-8bd2-462a-a7f4-2dc34ac557e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:20.724486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-21157572-8bd2-462a-a7f4-2dc34ac557e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:20.731988 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-21157572-8bd2-462a-a7f4-2dc34ac557e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:20.732521 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-21157572-8bd2-462a-a7f4-2dc34ac557e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:20.733298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-21157572-8bd2-462a-a7f4-2dc34ac557e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:20.733734 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-21157572-8bd2-462a-a7f4-2dc34ac557e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:20.882513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-21157572-8bd2-462a-a7f4-2dc34ac557e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:20.892971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-21157572-8bd2-462a-a7f4-2dc34ac557e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:20.894615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-21157572-8bd2-462a-a7f4-2dc34ac557e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:20.896250 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-21157572-8bd2-462a-a7f4-2dc34ac557e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.177300 Aug 19 09:23:20.896903 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 489/955] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:20 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:23:21.185326 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-dc268c57-0e3d-4595-a4e1-3e252a5089d1 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:21.186026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-dc268c57-0e3d-4595-a4e1-3e252a5089d1 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:21.192163 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dc268c57-0e3d-4595-a4e1-3e252a5089d1 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:21.192607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dc268c57-0e3d-4595-a4e1-3e252a5089d1 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:21.193413 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dc268c57-0e3d-4595-a4e1-3e252a5089d1 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:21.193846 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dc268c57-0e3d-4595-a4e1-3e252a5089d1 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:21.269396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-572a1230-719a-4949-be02-6fe326c76395 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:21.270517 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-572a1230-719a-4949-be02-6fe326c76395 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:21.278145 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-572a1230-719a-4949-be02-6fe326c76395 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:21.279109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-572a1230-719a-4949-be02-6fe326c76395 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:21.280374 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-572a1230-719a-4949-be02-6fe326c76395 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:21.280977 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-572a1230-719a-4949-be02-6fe326c76395 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:21.463843 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dc268c57-0e3d-4595-a4e1-3e252a5089d1 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:21.474993 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-dc268c57-0e3d-4595-a4e1-3e252a5089d1 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1319 microversion: 2.1 time: 0.294351 Aug 19 09:23:21.476169 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 467/956] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:21 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:21.503474 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-572a1230-719a-4949-be02-6fe326c76395 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.238749 Aug 19 09:23:21.504472 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 490/957] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:21 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:23:21.915939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9a5f6038-0199-415c-be54-006c55b8d34a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:21.916538 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9a5f6038-0199-415c-be54-006c55b8d34a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:21.922343 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9a5f6038-0199-415c-be54-006c55b8d34a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:21.922897 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9a5f6038-0199-415c-be54-006c55b8d34a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:21.923739 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9a5f6038-0199-415c-be54-006c55b8d34a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:21.924210 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9a5f6038-0199-415c-be54-006c55b8d34a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:22.050494 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9a5f6038-0199-415c-be54-006c55b8d34a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:22.061109 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9a5f6038-0199-415c-be54-006c55b8d34a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:22.063134 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9a5f6038-0199-415c-be54-006c55b8d34a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:22.064817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9a5f6038-0199-415c-be54-006c55b8d34a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1810 microversion: 2.20 time: 0.153172 Aug 19 09:23:22.065663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 468/958] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:21 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:23:22.491570 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c5d79b4e-8519-4296-ab70-c62246dffb6c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:22.492415 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c5d79b4e-8519-4296-ab70-c62246dffb6c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:22.499166 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c5d79b4e-8519-4296-ab70-c62246dffb6c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:22.499617 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c5d79b4e-8519-4296-ab70-c62246dffb6c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:22.500403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c5d79b4e-8519-4296-ab70-c62246dffb6c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:22.500816 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c5d79b4e-8519-4296-ab70-c62246dffb6c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:22.515914 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4a51ad6e-3327-4499-9024-7f7a5a29c8fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:22.517353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4a51ad6e-3327-4499-9024-7f7a5a29c8fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:22.524014 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a51ad6e-3327-4499-9024-7f7a5a29c8fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:22.524959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a51ad6e-3327-4499-9024-7f7a5a29c8fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:22.525906 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a51ad6e-3327-4499-9024-7f7a5a29c8fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:22.526335 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4a51ad6e-3327-4499-9024-7f7a5a29c8fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:22.625893 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4a51ad6e-3327-4499-9024-7f7a5a29c8fc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.113056 Aug 19 09:23:22.627009 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 469/959] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:22 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:23:22.629315 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c5d79b4e-8519-4296-ab70-c62246dffb6c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:22.637648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c5d79b4e-8519-4296-ab70-c62246dffb6c tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1319 microversion: 2.1 time: 0.150069 Aug 19 09:23:22.639949 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 491/960] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:22 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:23.085301 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-716549c4-aa42-407e-b73a-10391281418b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:23.085979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-716549c4-aa42-407e-b73a-10391281418b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:23.092968 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-716549c4-aa42-407e-b73a-10391281418b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:23.093406 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-716549c4-aa42-407e-b73a-10391281418b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:23.094157 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-716549c4-aa42-407e-b73a-10391281418b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:23.094581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-716549c4-aa42-407e-b73a-10391281418b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:23.218453 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-716549c4-aa42-407e-b73a-10391281418b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:23.227176 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-716549c4-aa42-407e-b73a-10391281418b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:23.228948 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-716549c4-aa42-407e-b73a-10391281418b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:23.230068 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-716549c4-aa42-407e-b73a-10391281418b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1797 microversion: 2.20 time: 0.148834 Aug 19 09:23:23.230618 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 470/961] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:23:23 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1797 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:23:23.638087 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ea007d79-a2b8-4065-aea4-f74292ca04e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:23.638903 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ea007d79-a2b8-4065-aea4-f74292ca04e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:23.645119 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea007d79-a2b8-4065-aea4-f74292ca04e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:23.645563 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea007d79-a2b8-4065-aea4-f74292ca04e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:23.646316 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea007d79-a2b8-4065-aea4-f74292ca04e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:23.646746 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea007d79-a2b8-4065-aea4-f74292ca04e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:23.655757 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6570ff29-39c7-44f3-b5d8-61ecd59b1ade tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:23.656361 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6570ff29-39c7-44f3-b5d8-61ecd59b1ade tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:23.661981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6570ff29-39c7-44f3-b5d8-61ecd59b1ade tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:23.662432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6570ff29-39c7-44f3-b5d8-61ecd59b1ade tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:23.663195 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6570ff29-39c7-44f3-b5d8-61ecd59b1ade tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:23.663656 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6570ff29-39c7-44f3-b5d8-61ecd59b1ade tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:23.741167 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ea007d79-a2b8-4065-aea4-f74292ca04e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.106579 Aug 19 09:23:23.741672 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 492/962] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:23 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:23.782218 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6570ff29-39c7-44f3-b5d8-61ecd59b1ade tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:23.789352 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6570ff29-39c7-44f3-b5d8-61ecd59b1ade tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1319 microversion: 2.1 time: 0.137113 Aug 19 09:23:23.789912 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 471/963] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:23 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1319 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:23:24.754049 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-10f6370f-af91-402d-97d4-4cae1415f216 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:24.754997 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-10f6370f-af91-402d-97d4-4cae1415f216 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:24.762131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10f6370f-af91-402d-97d4-4cae1415f216 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:24.762630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10f6370f-af91-402d-97d4-4cae1415f216 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:24.763426 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10f6370f-af91-402d-97d4-4cae1415f216 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:24.763862 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-10f6370f-af91-402d-97d4-4cae1415f216 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:24.805976 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f58678d0-1b47-48e4-9154-93fe74ffb6de tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:24.806713 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f58678d0-1b47-48e4-9154-93fe74ffb6de tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:24.813997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f58678d0-1b47-48e4-9154-93fe74ffb6de tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:24.814438 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f58678d0-1b47-48e4-9154-93fe74ffb6de tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:24.815196 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f58678d0-1b47-48e4-9154-93fe74ffb6de tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:24.815658 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f58678d0-1b47-48e4-9154-93fe74ffb6de tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:24.867366 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-10f6370f-af91-402d-97d4-4cae1415f216 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.117186 Aug 19 09:23:24.868264 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 493/964] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:24 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:24.939544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f58678d0-1b47-48e4-9154-93fe74ffb6de tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:24.946605 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f58678d0-1b47-48e4-9154-93fe74ffb6de tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1319 microversion: 2.1 time: 0.144614 Aug 19 09:23:24.947171 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 472/965] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:24 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:23:25.880521 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0ea99586-93dc-4314-b60f-88215b30441e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:25.881549 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0ea99586-93dc-4314-b60f-88215b30441e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:25.888437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0ea99586-93dc-4314-b60f-88215b30441e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:25.888437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0ea99586-93dc-4314-b60f-88215b30441e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:25.889191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0ea99586-93dc-4314-b60f-88215b30441e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:25.889593 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0ea99586-93dc-4314-b60f-88215b30441e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:25.962808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a94cfe22-2d96-41ea-bbc7-cd455811d1f5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:25.963910 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a94cfe22-2d96-41ea-bbc7-cd455811d1f5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:25.969336 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a94cfe22-2d96-41ea-bbc7-cd455811d1f5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:25.969775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a94cfe22-2d96-41ea-bbc7-cd455811d1f5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:25.970532 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a94cfe22-2d96-41ea-bbc7-cd455811d1f5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:25.970751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0ea99586-93dc-4314-b60f-88215b30441e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.094695 Aug 19 09:23:25.970958 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a94cfe22-2d96-41ea-bbc7-cd455811d1f5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:25.975005 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 494/966] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:25 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:26.093529 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a94cfe22-2d96-41ea-bbc7-cd455811d1f5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:26.100866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a94cfe22-2d96-41ea-bbc7-cd455811d1f5 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1319 microversion: 2.1 time: 0.141649 Aug 19 09:23:26.101418 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 473/967] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:25 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:23:26.645512 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-65ff0df3-5cff-4e36-9d3a-174b1c2aabda req-9425b17c-6869-4d1c-be8b-4134bf69c80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0287d415-3c4d-439f-93f0-a11db16c282b", "name": "network-vif-plugged", "status": "completed", "tag": "6547a078-9434-436e-b393-e0a15dc6d5c6"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:26.647006 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:23:26.647006 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:23:26.655854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-65ff0df3-5cff-4e36-9d3a-174b1c2aabda req-9425b17c-6869-4d1c-be8b-4134bf69c80f service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:26.656308 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-65ff0df3-5cff-4e36-9d3a-174b1c2aabda req-9425b17c-6869-4d1c-be8b-4134bf69c80f service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:26.667253 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-65ff0df3-5cff-4e36-9d3a-174b1c2aabda req-9425b17c-6869-4d1c-be8b-4134bf69c80f service nova] Creating event network-vif-plugged:6547a078-9434-436e-b393-e0a15dc6d5c6 for instance 0287d415-3c4d-439f-93f0-a11db16c282b on hv-cinder-77387 Aug 19 09:23:26.671779 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-65ff0df3-5cff-4e36-9d3a-174b1c2aabda req-9425b17c-6869-4d1c-be8b-4134bf69c80f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030291 Aug 19 09:23:26.672353 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 495/968] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:23:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:23:26.983096 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d1084acc-1810-46c9-9ff8-3ed4e0addfdf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:26.984029 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d1084acc-1810-46c9-9ff8-3ed4e0addfdf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:26.990148 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d1084acc-1810-46c9-9ff8-3ed4e0addfdf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:26.990590 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d1084acc-1810-46c9-9ff8-3ed4e0addfdf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:26.991367 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d1084acc-1810-46c9-9ff8-3ed4e0addfdf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:26.991800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d1084acc-1810-46c9-9ff8-3ed4e0addfdf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:27.118061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7f5e2b31-8103-43f4-ae15-4578c6a625ae tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:27.118754 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7f5e2b31-8103-43f4-ae15-4578c6a625ae tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:27.126467 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f5e2b31-8103-43f4-ae15-4578c6a625ae tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:27.127043 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f5e2b31-8103-43f4-ae15-4578c6a625ae tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:27.128122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f5e2b31-8103-43f4-ae15-4578c6a625ae tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:27.128555 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f5e2b31-8103-43f4-ae15-4578c6a625ae tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:27.258588 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7f5e2b31-8103-43f4-ae15-4578c6a625ae tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:27.266571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7f5e2b31-8103-43f4-ae15-4578c6a625ae tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1319 microversion: 2.1 time: 0.152483 Aug 19 09:23:27.267363 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 496/969] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:27 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:23:27.450647 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d1084acc-1810-46c9-9ff8-3ed4e0addfdf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.471853 Aug 19 09:23:27.451292 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 474/970] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:26 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:28.284777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1ac7697e-d6b7-450f-a07d-81a540ff6e0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:28.285380 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1ac7697e-d6b7-450f-a07d-81a540ff6e0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:28.291702 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1ac7697e-d6b7-450f-a07d-81a540ff6e0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:28.292148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1ac7697e-d6b7-450f-a07d-81a540ff6e0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:28.292899 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1ac7697e-d6b7-450f-a07d-81a540ff6e0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:28.293327 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1ac7697e-d6b7-450f-a07d-81a540ff6e0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:28.416625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1ac7697e-d6b7-450f-a07d-81a540ff6e0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:28.423673 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1ac7697e-d6b7-450f-a07d-81a540ff6e0d tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1319 microversion: 2.1 time: 0.142498 Aug 19 09:23:28.424243 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 497/971] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:28 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:28.462789 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-275d81fb-d9f9-4188-94c8-1ce2e283b3d3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:28.464588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-275d81fb-d9f9-4188-94c8-1ce2e283b3d3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:28.470967 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-275d81fb-d9f9-4188-94c8-1ce2e283b3d3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:28.471534 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-275d81fb-d9f9-4188-94c8-1ce2e283b3d3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:28.472474 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-275d81fb-d9f9-4188-94c8-1ce2e283b3d3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:28.472958 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-275d81fb-d9f9-4188-94c8-1ce2e283b3d3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:28.567194 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-275d81fb-d9f9-4188-94c8-1ce2e283b3d3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.108341 Aug 19 09:23:28.571011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 475/972] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:28 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:29.440649 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f829dcd7-b8d7-47a7-96eb-d6a12ff3b185 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:29.441259 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f829dcd7-b8d7-47a7-96eb-d6a12ff3b185 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:29.446857 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f829dcd7-b8d7-47a7-96eb-d6a12ff3b185 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:29.447324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f829dcd7-b8d7-47a7-96eb-d6a12ff3b185 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:29.448605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f829dcd7-b8d7-47a7-96eb-d6a12ff3b185 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:29.449060 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f829dcd7-b8d7-47a7-96eb-d6a12ff3b185 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:29.579607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6cb4705d-efd4-45c4-823c-51f1b59f0088 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:29.580956 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6cb4705d-efd4-45c4-823c-51f1b59f0088 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:29.587587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6cb4705d-efd4-45c4-823c-51f1b59f0088 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:29.588110 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6cb4705d-efd4-45c4-823c-51f1b59f0088 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:29.589844 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6cb4705d-efd4-45c4-823c-51f1b59f0088 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:29.590368 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6cb4705d-efd4-45c4-823c-51f1b59f0088 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:29.594904 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f829dcd7-b8d7-47a7-96eb-d6a12ff3b185 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:29.602898 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f829dcd7-b8d7-47a7-96eb-d6a12ff3b185 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1508 microversion: 2.1 time: 0.165886 Aug 19 09:23:29.603479 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 498/973] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:29 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:29.621202 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-00eaadd9-6a43-45a2-89ef-6f707c02a486 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43390529-c8be-4aa4-b955-d04190a09f8b", "device": "/dev/sdb"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:29.622294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-00eaadd9-6a43-45a2-89ef-6f707c02a486 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:29.628058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00eaadd9-6a43-45a2-89ef-6f707c02a486 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:29.628576 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00eaadd9-6a43-45a2-89ef-6f707c02a486 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:29.629415 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00eaadd9-6a43-45a2-89ef-6f707c02a486 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:29.629856 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-00eaadd9-6a43-45a2-89ef-6f707c02a486 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:29.676863 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6cb4705d-efd4-45c4-823c-51f1b59f0088 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.101446 Aug 19 09:23:29.677708 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 476/974] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:29 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:29.883622 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-00eaadd9-6a43-45a2-89ef-6f707c02a486 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "POST /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266913 Aug 19 09:23:29.889577 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 499/975] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:23:29 2021] POST /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:23:30.689920 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7fe9da08-9cec-4691-8575-764352d576cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:30.690911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7fe9da08-9cec-4691-8575-764352d576cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:30.702363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7fe9da08-9cec-4691-8575-764352d576cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:30.702363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7fe9da08-9cec-4691-8575-764352d576cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:30.702363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7fe9da08-9cec-4691-8575-764352d576cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:30.702363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7fe9da08-9cec-4691-8575-764352d576cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:30.798027 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7fe9da08-9cec-4691-8575-764352d576cb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.112200 Aug 19 09:23:30.798662 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 477/976] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:30 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:31.810390 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-608957d8-5701-4fc9-a07c-7c6262af8c31 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:31.811451 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-608957d8-5701-4fc9-a07c-7c6262af8c31 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:31.817417 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-608957d8-5701-4fc9-a07c-7c6262af8c31 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:31.817854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-608957d8-5701-4fc9-a07c-7c6262af8c31 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:31.818597 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-608957d8-5701-4fc9-a07c-7c6262af8c31 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:31.819020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-608957d8-5701-4fc9-a07c-7c6262af8c31 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:31.914760 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-608957d8-5701-4fc9-a07c-7c6262af8c31 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.108697 Aug 19 09:23:31.915410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 500/977] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:31 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:32.926549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ac0659ad-3d70-4fca-bea1-5b57e2571697 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:32.927599 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ac0659ad-3d70-4fca-bea1-5b57e2571697 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:32.934167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ac0659ad-3d70-4fca-bea1-5b57e2571697 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:32.934616 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ac0659ad-3d70-4fca-bea1-5b57e2571697 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:32.935408 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ac0659ad-3d70-4fca-bea1-5b57e2571697 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:32.935845 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ac0659ad-3d70-4fca-bea1-5b57e2571697 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:37.193544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ac0659ad-3d70-4fca-bea1-5b57e2571697 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 4.270799 Aug 19 09:23:37.194237 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 478/978] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:32 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 4273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:38.204927 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f95a471a-b865-4e38-b4de-d3192d1ce56d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:38.205912 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f95a471a-b865-4e38-b4de-d3192d1ce56d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:38.212306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f95a471a-b865-4e38-b4de-d3192d1ce56d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:38.212746 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f95a471a-b865-4e38-b4de-d3192d1ce56d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:38.213495 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f95a471a-b865-4e38-b4de-d3192d1ce56d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:38.213921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f95a471a-b865-4e38-b4de-d3192d1ce56d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:38.324061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f95a471a-b865-4e38-b4de-d3192d1ce56d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.122893 Aug 19 09:23:38.325407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 501/979] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:38 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:23:39.336089 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9142d3f4-ed8b-4505-a938-22b0646248b6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:39.337070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9142d3f4-ed8b-4505-a938-22b0646248b6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:39.343911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9142d3f4-ed8b-4505-a938-22b0646248b6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:39.344351 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9142d3f4-ed8b-4505-a938-22b0646248b6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:39.345105 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9142d3f4-ed8b-4505-a938-22b0646248b6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:39.345530 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9142d3f4-ed8b-4505-a938-22b0646248b6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:39.457351 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9142d3f4-ed8b-4505-a938-22b0646248b6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.124904 Aug 19 09:23:39.458262 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 479/980] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:39 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:40.469495 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-60dbee82-ebf2-4200-9ddd-3b6e7b54b783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:40.470503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-60dbee82-ebf2-4200-9ddd-3b6e7b54b783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:40.477210 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-60dbee82-ebf2-4200-9ddd-3b6e7b54b783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:40.477654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-60dbee82-ebf2-4200-9ddd-3b6e7b54b783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:40.478414 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-60dbee82-ebf2-4200-9ddd-3b6e7b54b783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:40.478850 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-60dbee82-ebf2-4200-9ddd-3b6e7b54b783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:43.682968 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-60dbee82-ebf2-4200-9ddd-3b6e7b54b783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 3.217622 Aug 19 09:23:43.684548 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 502/981] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:40 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 3220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:44.696033 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8ac9d557-6f57-4dc8-b0f2-919145f4d634 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:44.697027 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8ac9d557-6f57-4dc8-b0f2-919145f4d634 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:44.704353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ac9d557-6f57-4dc8-b0f2-919145f4d634 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:44.704802 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ac9d557-6f57-4dc8-b0f2-919145f4d634 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:44.705579 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ac9d557-6f57-4dc8-b0f2-919145f4d634 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:44.706012 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ac9d557-6f57-4dc8-b0f2-919145f4d634 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:44.792991 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8ac9d557-6f57-4dc8-b0f2-919145f4d634 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.100983 Aug 19 09:23:44.793637 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 480/982] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:44 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:45.805199 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-91313bf5-fce2-4ec3-b47d-80676563e624 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:45.806177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-91313bf5-fce2-4ec3-b47d-80676563e624 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:45.813111 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-91313bf5-fce2-4ec3-b47d-80676563e624 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:45.813621 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-91313bf5-fce2-4ec3-b47d-80676563e624 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:45.814410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-91313bf5-fce2-4ec3-b47d-80676563e624 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:45.814840 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-91313bf5-fce2-4ec3-b47d-80676563e624 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:49.203906 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-91313bf5-fce2-4ec3-b47d-80676563e624 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 3.402464 Aug 19 09:23:49.204565 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 503/983] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:45 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 3404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:50.217492 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9e855755-7e17-4df4-897f-d6477ce86188 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:50.218526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9e855755-7e17-4df4-897f-d6477ce86188 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:50.225783 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e855755-7e17-4df4-897f-d6477ce86188 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:50.226233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e855755-7e17-4df4-897f-d6477ce86188 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:50.227111 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e855755-7e17-4df4-897f-d6477ce86188 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:50.227509 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9e855755-7e17-4df4-897f-d6477ce86188 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:50.333331 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9e855755-7e17-4df4-897f-d6477ce86188 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.121013 Aug 19 09:23:50.334186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 481/984] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:50 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:51.344830 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e63193da-14f8-4d57-854e-d7ff95356e2c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:51.345823 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e63193da-14f8-4d57-854e-d7ff95356e2c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:51.352803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e63193da-14f8-4d57-854e-d7ff95356e2c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:51.353252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e63193da-14f8-4d57-854e-d7ff95356e2c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:51.354023 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e63193da-14f8-4d57-854e-d7ff95356e2c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:51.354457 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e63193da-14f8-4d57-854e-d7ff95356e2c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:51.439416 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e63193da-14f8-4d57-854e-d7ff95356e2c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.098377 Aug 19 09:23:51.440039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 504/985] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:51 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:52.450365 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-da7383e3-8bb6-47c4-9c9d-70298c8b664c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:52.451434 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-da7383e3-8bb6-47c4-9c9d-70298c8b664c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:52.457764 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-da7383e3-8bb6-47c4-9c9d-70298c8b664c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:52.458203 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-da7383e3-8bb6-47c4-9c9d-70298c8b664c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:52.458956 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-da7383e3-8bb6-47c4-9c9d-70298c8b664c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:52.459412 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-da7383e3-8bb6-47c4-9c9d-70298c8b664c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:52.551526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-da7383e3-8bb6-47c4-9c9d-70298c8b664c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.105140 Aug 19 09:23:52.552135 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 482/986] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:52 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:53.431037 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-514faad7-eabd-41bd-8998-81ac46ddd309 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:53.431659 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-514faad7-eabd-41bd-8998-81ac46ddd309 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:53.438237 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-514faad7-eabd-41bd-8998-81ac46ddd309 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:53.438683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-514faad7-eabd-41bd-8998-81ac46ddd309 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:53.439479 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-514faad7-eabd-41bd-8998-81ac46ddd309 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:53.439910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-514faad7-eabd-41bd-8998-81ac46ddd309 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:53.522228 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-514faad7-eabd-41bd-8998-81ac46ddd309 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lazy-loading 'services' on Instance uuid 0287d415-3c4d-439f-93f0-a11db16c282b {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:23:53.563639 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-59b0c41e-cd8d-4ebf-a7f6-f510c26d9933 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:53.564663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-59b0c41e-cd8d-4ebf-a7f6-f510c26d9933 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:53.571873 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-59b0c41e-cd8d-4ebf-a7f6-f510c26d9933 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:53.572322 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-59b0c41e-cd8d-4ebf-a7f6-f510c26d9933 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:53.573093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-59b0c41e-cd8d-4ebf-a7f6-f510c26d9933 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:53.573525 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-59b0c41e-cd8d-4ebf-a7f6-f510c26d9933 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:53.588696 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-514faad7-eabd-41bd-8998-81ac46ddd309 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b/os-volume_attachments/43390529-c8be-4aa4-b955-d04190a09f8b" status: 202 len: 0 microversion: 2.1 time: 0.161563 Aug 19 09:23:53.589267 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 505/987] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:23:53 2021] DELETE /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b/os-volume_attachments/43390529-c8be-4aa4-b955-d04190a09f8b => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:23:53.676411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-59b0c41e-cd8d-4ebf-a7f6-f510c26d9933 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.116650 Aug 19 09:23:53.677064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 483/988] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:53 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:23:54.688018 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-28267e80-127f-47b2-ab3b-289c1f7e329c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:54.689067 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-28267e80-127f-47b2-ab3b-289c1f7e329c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:54.695569 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-28267e80-127f-47b2-ab3b-289c1f7e329c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:54.696028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-28267e80-127f-47b2-ab3b-289c1f7e329c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:54.696800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-28267e80-127f-47b2-ab3b-289c1f7e329c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:54.697235 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-28267e80-127f-47b2-ab3b-289c1f7e329c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:54.708959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-395d5266-7aaa-4a56-8808-1cb33597e496 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:54.709538 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-395d5266-7aaa-4a56-8808-1cb33597e496 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:54.716521 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-395d5266-7aaa-4a56-8808-1cb33597e496 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:54.716962 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-395d5266-7aaa-4a56-8808-1cb33597e496 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:54.717731 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-395d5266-7aaa-4a56-8808-1cb33597e496 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:54.718163 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-395d5266-7aaa-4a56-8808-1cb33597e496 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:54.743040 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-395d5266-7aaa-4a56-8808-1cb33597e496 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:23:54.788975 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-28267e80-127f-47b2-ab3b-289c1f7e329c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.104641 Aug 19 09:23:54.789533 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 506/989] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:54 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:54.818026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-395d5266-7aaa-4a56-8808-1cb33597e496 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 204 len: 0 microversion: 2.1 time: 0.112766 Aug 19 09:23:54.818602 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 484/990] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:23:54 2021] DELETE /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 09:23:54.827300 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0f457917-20ab-4b58-b4f6-f6300b61c392 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:54.828000 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0f457917-20ab-4b58-b4f6-f6300b61c392 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:54.834367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0f457917-20ab-4b58-b4f6-f6300b61c392 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:54.834813 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0f457917-20ab-4b58-b4f6-f6300b61c392 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:54.835650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0f457917-20ab-4b58-b4f6-f6300b61c392 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:54.836085 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0f457917-20ab-4b58-b4f6-f6300b61c392 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:54.958030 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0f457917-20ab-4b58-b4f6-f6300b61c392 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:54.965833 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0f457917-20ab-4b58-b4f6-f6300b61c392 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1514 microversion: 2.1 time: 0.142532 Aug 19 09:23:54.966421 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 507/991] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:54 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:55.802216 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bda8e187-2ca3-4d16-8428-3c23303eac7c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:55.803136 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bda8e187-2ca3-4d16-8428-3c23303eac7c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:55.810088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bda8e187-2ca3-4d16-8428-3c23303eac7c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:55.810527 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bda8e187-2ca3-4d16-8428-3c23303eac7c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:55.811317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bda8e187-2ca3-4d16-8428-3c23303eac7c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:55.811753 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bda8e187-2ca3-4d16-8428-3c23303eac7c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:55.899557 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bda8e187-2ca3-4d16-8428-3c23303eac7c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.101280 Aug 19 09:23:55.900166 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 485/992] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:55 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:55.983584 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b98d3eec-b8bb-4984-b6b2-6d6814e0bc82 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:55.984185 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b98d3eec-b8bb-4984-b6b2-6d6814e0bc82 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:55.990400 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b98d3eec-b8bb-4984-b6b2-6d6814e0bc82 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:55.990839 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b98d3eec-b8bb-4984-b6b2-6d6814e0bc82 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:55.991615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b98d3eec-b8bb-4984-b6b2-6d6814e0bc82 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:55.992041 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b98d3eec-b8bb-4984-b6b2-6d6814e0bc82 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:56.114055 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b98d3eec-b8bb-4984-b6b2-6d6814e0bc82 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:56.121358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b98d3eec-b8bb-4984-b6b2-6d6814e0bc82 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1514 microversion: 2.1 time: 0.142195 Aug 19 09:23:56.121902 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 508/993] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:55 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1514 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:56.911251 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a8974851-1020-48db-be41-2d337aba9d03 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:56.912261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a8974851-1020-48db-be41-2d337aba9d03 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:56.918636 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a8974851-1020-48db-be41-2d337aba9d03 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:56.919081 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a8974851-1020-48db-be41-2d337aba9d03 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:56.919876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a8974851-1020-48db-be41-2d337aba9d03 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:56.920310 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a8974851-1020-48db-be41-2d337aba9d03 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:57.007167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a8974851-1020-48db-be41-2d337aba9d03 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.099925 Aug 19 09:23:57.011087 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 486/994] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:56 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:57.138248 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-98695f9c-c35c-4075-9917-2dedaf9186ee tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:57.138861 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-98695f9c-c35c-4075-9917-2dedaf9186ee tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:57.144867 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98695f9c-c35c-4075-9917-2dedaf9186ee tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:57.145304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98695f9c-c35c-4075-9917-2dedaf9186ee tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:57.146066 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98695f9c-c35c-4075-9917-2dedaf9186ee tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:57.146491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98695f9c-c35c-4075-9917-2dedaf9186ee tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:57.267503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-98695f9c-c35c-4075-9917-2dedaf9186ee tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ac96455c3e469d94469fcaf530290a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed982dbeb62c47f9b68eed4195a3e3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:23:57.274792 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-98695f9c-c35c-4075-9917-2dedaf9186ee tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 200 len: 1514 microversion: 2.1 time: 0.140723 Aug 19 09:23:57.275379 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 509/995] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:57 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 1514 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:23:57.376360 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-b596d53a-fea6-4642-abd6-580e6595bbd0 req-a73c1c73-c63a-4349-9e08-5a35fa831bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0287d415-3c4d-439f-93f0-a11db16c282b", "name": "network-vif-deleted", "tag": "6547a078-9434-436e-b393-e0a15dc6d5c6"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:57.378245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:23:57.378245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:23:57.388483 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-b596d53a-fea6-4642-abd6-580e6595bbd0 req-a73c1c73-c63a-4349-9e08-5a35fa831bab service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:57.388916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-b596d53a-fea6-4642-abd6-580e6595bbd0 req-a73c1c73-c63a-4349-9e08-5a35fa831bab service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:57.400618 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-b596d53a-fea6-4642-abd6-580e6595bbd0 req-a73c1c73-c63a-4349-9e08-5a35fa831bab service nova] Creating event network-vif-deleted:6547a078-9434-436e-b393-e0a15dc6d5c6 for instance 0287d415-3c4d-439f-93f0-a11db16c282b on hv-cinder-77387 Aug 19 09:23:57.406188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-b596d53a-fea6-4642-abd6-580e6595bbd0 req-a73c1c73-c63a-4349-9e08-5a35fa831bab service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034153 Aug 19 09:23:57.406955 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 487/996] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:23:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:23:58.018017 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7c153b20-7a72-4386-be42-a8e278f51bfe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:58.018999 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7c153b20-7a72-4386-be42-a8e278f51bfe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:58.025159 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7c153b20-7a72-4386-be42-a8e278f51bfe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:58.025603 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7c153b20-7a72-4386-be42-a8e278f51bfe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:58.026353 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7c153b20-7a72-4386-be42-a8e278f51bfe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:58.026779 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7c153b20-7a72-4386-be42-a8e278f51bfe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:58.106131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7c153b20-7a72-4386-be42-a8e278f51bfe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.091056 Aug 19 09:23:58.106649 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 510/997] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:58 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:23:58.293360 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-74d11a0d-fed5-4f06-a3b6-0a9c5135cbc7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:23:58.294070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-74d11a0d-fed5-4f06-a3b6-0a9c5135cbc7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] [instance: 0287d415-3c4d-439f-93f0-a11db16c282b] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:58.300115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74d11a0d-fed5-4f06-a3b6-0a9c5135cbc7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:58.300562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74d11a0d-fed5-4f06-a3b6-0a9c5135cbc7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:58.301316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74d11a0d-fed5-4f06-a3b6-0a9c5135cbc7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:58.301756 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74d11a0d-fed5-4f06-a3b6-0a9c5135cbc7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:58.314444 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-74d11a0d-fed5-4f06-a3b6-0a9c5135cbc7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] HTTP exception thrown: Instance 0287d415-3c4d-439f-93f0-a11db16c282b could not be found. Aug 19 09:23:58.315018 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-74d11a0d-fed5-4f06-a3b6-0a9c5135cbc7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] Returning 404 to user: Instance 0287d415-3c4d-439f-93f0-a11db16c282b could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:23:58.315849 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-74d11a0d-fed5-4f06-a3b6-0a9c5135cbc7 tempest-VolumesSnapshotTestJSON-215151161 tempest-VolumesSnapshotTestJSON-215151161-project] 10.222.0.32 "GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b" status: 404 len: 111 microversion: 2.1 time: 0.027264 Aug 19 09:23:58.316359 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 488/998] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:23:58 2021] GET /compute/v2.1/servers/0287d415-3c4d-439f-93f0-a11db16c282b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:23:59.118063 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-92480ef1-5c94-42b4-84f5-ce3153a740d1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:23:59.119052 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-92480ef1-5c94-42b4-84f5-ce3153a740d1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:23:59.126104 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-92480ef1-5c94-42b4-84f5-ce3153a740d1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:59.126543 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-92480ef1-5c94-42b4-84f5-ce3153a740d1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:59.127325 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-92480ef1-5c94-42b4-84f5-ce3153a740d1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:23:59.127757 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-92480ef1-5c94-42b4-84f5-ce3153a740d1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:23:59.208957 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-92480ef1-5c94-42b4-84f5-ce3153a740d1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.094862 Aug 19 09:23:59.209553 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 511/999] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:23:59 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:00.220814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6a5ea29b-1343-41da-84ec-68f0e0dff4ee tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:00.221720 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6a5ea29b-1343-41da-84ec-68f0e0dff4ee tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:00.228061 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6a5ea29b-1343-41da-84ec-68f0e0dff4ee tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:00.228506 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6a5ea29b-1343-41da-84ec-68f0e0dff4ee tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:00.229269 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6a5ea29b-1343-41da-84ec-68f0e0dff4ee tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:00.229701 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6a5ea29b-1343-41da-84ec-68f0e0dff4ee tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:03.509277 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6a5ea29b-1343-41da-84ec-68f0e0dff4ee tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 3.291515 Aug 19 09:24:03.513958 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 489/1000] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:00 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 3294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:04.522143 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f9b4cf88-7fe8-4f87-a845-94352e979e92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:04.523082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f9b4cf88-7fe8-4f87-a845-94352e979e92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:04.530097 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9b4cf88-7fe8-4f87-a845-94352e979e92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:04.530534 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9b4cf88-7fe8-4f87-a845-94352e979e92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:04.531304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9b4cf88-7fe8-4f87-a845-94352e979e92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:04.531735 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9b4cf88-7fe8-4f87-a845-94352e979e92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:04.612669 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f9b4cf88-7fe8-4f87-a845-94352e979e92 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.094448 Aug 19 09:24:04.613275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 512/1001] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:04 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:05.623949 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-aafa58f7-6b0f-4f06-86df-7c796652d87b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:05.624964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-aafa58f7-6b0f-4f06-86df-7c796652d87b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:05.631355 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aafa58f7-6b0f-4f06-86df-7c796652d87b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:05.631800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aafa58f7-6b0f-4f06-86df-7c796652d87b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:05.632555 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aafa58f7-6b0f-4f06-86df-7c796652d87b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:05.632981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-aafa58f7-6b0f-4f06-86df-7c796652d87b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:05.724944 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-aafa58f7-6b0f-4f06-86df-7c796652d87b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.104925 Aug 19 09:24:05.725482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 490/1002] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:05 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:06.736957 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3b65a8fc-87ac-4147-90b7-8a65c1508a42 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:06.737942 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3b65a8fc-87ac-4147-90b7-8a65c1508a42 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:06.744434 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b65a8fc-87ac-4147-90b7-8a65c1508a42 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:06.744918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b65a8fc-87ac-4147-90b7-8a65c1508a42 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:06.745721 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b65a8fc-87ac-4147-90b7-8a65c1508a42 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:06.746178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3b65a8fc-87ac-4147-90b7-8a65c1508a42 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:06.824067 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3b65a8fc-87ac-4147-90b7-8a65c1508a42 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.091034 Aug 19 09:24:06.824685 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 513/1003] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:06 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:07.836124 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-acc06d8b-b498-44e1-9bbe-02137b9f34f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:07.837039 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-acc06d8b-b498-44e1-9bbe-02137b9f34f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:07.843418 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-acc06d8b-b498-44e1-9bbe-02137b9f34f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:07.843869 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-acc06d8b-b498-44e1-9bbe-02137b9f34f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:07.844623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-acc06d8b-b498-44e1-9bbe-02137b9f34f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:07.845055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-acc06d8b-b498-44e1-9bbe-02137b9f34f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:07.934089 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-acc06d8b-b498-44e1-9bbe-02137b9f34f4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.101207 Aug 19 09:24:07.934650 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 491/1004] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:07 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:08.946222 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c2060953-628c-4528-b254-ee69b4711e4c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:08.947143 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c2060953-628c-4528-b254-ee69b4711e4c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:08.953494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2060953-628c-4528-b254-ee69b4711e4c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:08.953938 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2060953-628c-4528-b254-ee69b4711e4c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:08.954697 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2060953-628c-4528-b254-ee69b4711e4c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:08.955128 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2060953-628c-4528-b254-ee69b4711e4c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:09.059693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c2060953-628c-4528-b254-ee69b4711e4c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.117379 Aug 19 09:24:09.060424 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 514/1005] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:08 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:10.072304 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-22712afc-7582-4a91-bcb5-9c7f707a3831 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:10.073296 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-22712afc-7582-4a91-bcb5-9c7f707a3831 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:10.079745 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22712afc-7582-4a91-bcb5-9c7f707a3831 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:10.080190 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22712afc-7582-4a91-bcb5-9c7f707a3831 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:10.080947 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22712afc-7582-4a91-bcb5-9c7f707a3831 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:10.081378 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22712afc-7582-4a91-bcb5-9c7f707a3831 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:12.934352 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-22712afc-7582-4a91-bcb5-9c7f707a3831 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 2.865651 Aug 19 09:24:12.934844 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 492/1006] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:10 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 2867 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:12.938091 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:24:12.938237 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:24:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:24:13.945840 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b8aa4795-899d-4bed-a5a1-e9527ed60ca2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:13.946829 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b8aa4795-899d-4bed-a5a1-e9527ed60ca2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:13.953892 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b8aa4795-899d-4bed-a5a1-e9527ed60ca2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:13.954343 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b8aa4795-899d-4bed-a5a1-e9527ed60ca2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:13.955110 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b8aa4795-899d-4bed-a5a1-e9527ed60ca2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:13.955571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b8aa4795-899d-4bed-a5a1-e9527ed60ca2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:14.036912 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b8aa4795-899d-4bed-a5a1-e9527ed60ca2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.094877 Aug 19 09:24:14.040766 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 515/1007] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:13 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:15.048633 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cb33b44d-1076-4ece-9f59-78c7ab4d4c6a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:15.049632 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-cb33b44d-1076-4ece-9f59-78c7ab4d4c6a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:15.056064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cb33b44d-1076-4ece-9f59-78c7ab4d4c6a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:15.056519 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cb33b44d-1076-4ece-9f59-78c7ab4d4c6a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:15.057283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cb33b44d-1076-4ece-9f59-78c7ab4d4c6a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:15.057719 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cb33b44d-1076-4ece-9f59-78c7ab4d4c6a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:15.142493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-cb33b44d-1076-4ece-9f59-78c7ab4d4c6a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.098460 Aug 19 09:24:15.143111 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 493/1008] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:15 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:16.154581 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-bac2aebb-f0f6-482e-855b-2b9c79647fd2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:16.155619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-bac2aebb-f0f6-482e-855b-2b9c79647fd2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:16.162014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bac2aebb-f0f6-482e-855b-2b9c79647fd2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:16.162461 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bac2aebb-f0f6-482e-855b-2b9c79647fd2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:16.163218 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bac2aebb-f0f6-482e-855b-2b9c79647fd2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:16.163677 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bac2aebb-f0f6-482e-855b-2b9c79647fd2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:16.243220 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-bac2aebb-f0f6-482e-855b-2b9c79647fd2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 28652 microversion: 2.1 time: 0.092504 Aug 19 09:24:16.243923 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 516/1009] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:16 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 28652 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:17.254892 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-810e1646-3894-4c22-89b9-1d5d6a7529b4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:17.255915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-810e1646-3894-4c22-89b9-1d5d6a7529b4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:17.262264 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-810e1646-3894-4c22-89b9-1d5d6a7529b4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:17.262703 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-810e1646-3894-4c22-89b9-1d5d6a7529b4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:17.263577 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-810e1646-3894-4c22-89b9-1d5d6a7529b4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:17.264010 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-810e1646-3894-4c22-89b9-1d5d6a7529b4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:17.366638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-810e1646-3894-4c22-89b9-1d5d6a7529b4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 30772 microversion: 2.1 time: 0.115607 Aug 19 09:24:17.367282 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 494/1010] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:17 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 30772 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:18.380397 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1f600dbe-629d-4cf5-a4b6-5ec226ff2e9e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:18.381381 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1f600dbe-629d-4cf5-a4b6-5ec226ff2e9e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:18.387730 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1f600dbe-629d-4cf5-a4b6-5ec226ff2e9e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:18.388317 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1f600dbe-629d-4cf5-a4b6-5ec226ff2e9e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:18.389092 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1f600dbe-629d-4cf5-a4b6-5ec226ff2e9e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:18.389520 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1f600dbe-629d-4cf5-a4b6-5ec226ff2e9e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:18.481484 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1f600dbe-629d-4cf5-a4b6-5ec226ff2e9e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 32713 microversion: 2.1 time: 0.105063 Aug 19 09:24:18.483204 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 517/1011] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:18 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 32713 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:19.494612 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2c7b59a3-0d79-4b1b-9920-044eef2abe59 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:19.495726 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2c7b59a3-0d79-4b1b-9920-044eef2abe59 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:19.502048 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2c7b59a3-0d79-4b1b-9920-044eef2abe59 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:19.502486 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2c7b59a3-0d79-4b1b-9920-044eef2abe59 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:19.503234 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2c7b59a3-0d79-4b1b-9920-044eef2abe59 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:19.503689 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2c7b59a3-0d79-4b1b-9920-044eef2abe59 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:19.601414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2c7b59a3-0d79-4b1b-9920-044eef2abe59 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 33669 microversion: 2.1 time: 0.110668 Aug 19 09:24:19.602034 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 495/1012] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:19 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 33669 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:20.614645 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b6f915da-cfe3-4f5b-924c-786bc644058f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:20.615574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b6f915da-cfe3-4f5b-924c-786bc644058f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:20.623656 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b6f915da-cfe3-4f5b-924c-786bc644058f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:20.624116 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b6f915da-cfe3-4f5b-924c-786bc644058f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:20.624894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b6f915da-cfe3-4f5b-924c-786bc644058f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:20.625341 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b6f915da-cfe3-4f5b-924c-786bc644058f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:20.729062 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b6f915da-cfe3-4f5b-924c-786bc644058f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 34961 microversion: 2.1 time: 0.118372 Aug 19 09:24:20.729676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 518/1013] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:20 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 34961 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:21.741960 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-78b5fc07-8d99-4362-ae6e-ea8ae7d9b7e7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:21.742914 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-78b5fc07-8d99-4362-ae6e-ea8ae7d9b7e7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:21.749610 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78b5fc07-8d99-4362-ae6e-ea8ae7d9b7e7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:21.750058 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78b5fc07-8d99-4362-ae6e-ea8ae7d9b7e7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:21.750820 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78b5fc07-8d99-4362-ae6e-ea8ae7d9b7e7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:21.751252 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-78b5fc07-8d99-4362-ae6e-ea8ae7d9b7e7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:21.852364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-78b5fc07-8d99-4362-ae6e-ea8ae7d9b7e7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 36106 microversion: 2.1 time: 0.114421 Aug 19 09:24:21.852970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 496/1014] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:21 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 36106 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:22.864284 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f9dab710-8c64-4577-a8bd-b5b57a3e6412 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:22.865273 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f9dab710-8c64-4577-a8bd-b5b57a3e6412 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:22.871680 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9dab710-8c64-4577-a8bd-b5b57a3e6412 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:22.872751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9dab710-8c64-4577-a8bd-b5b57a3e6412 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:22.873511 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9dab710-8c64-4577-a8bd-b5b57a3e6412 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:22.873942 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9dab710-8c64-4577-a8bd-b5b57a3e6412 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:22.976247 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f9dab710-8c64-4577-a8bd-b5b57a3e6412 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 37759 microversion: 2.1 time: 0.115883 Aug 19 09:24:22.977187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 519/1015] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:22 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 37759 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:23.988993 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-19dba5eb-3ca1-4036-8aac-f29cdafef72b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:23.990240 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-19dba5eb-3ca1-4036-8aac-f29cdafef72b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:23.996592 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19dba5eb-3ca1-4036-8aac-f29cdafef72b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:23.997604 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19dba5eb-3ca1-4036-8aac-f29cdafef72b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:23.998364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19dba5eb-3ca1-4036-8aac-f29cdafef72b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:23.998797 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19dba5eb-3ca1-4036-8aac-f29cdafef72b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:24.089517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-19dba5eb-3ca1-4036-8aac-f29cdafef72b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 38187 microversion: 2.1 time: 0.104892 Aug 19 09:24:24.090162 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 497/1016] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:23 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 38187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:25.101505 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c283b027-549b-4b86-b6c6-c2a1cde2c686 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:25.102489 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c283b027-549b-4b86-b6c6-c2a1cde2c686 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:25.109587 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c283b027-549b-4b86-b6c6-c2a1cde2c686 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:25.110028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c283b027-549b-4b86-b6c6-c2a1cde2c686 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:25.110782 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c283b027-549b-4b86-b6c6-c2a1cde2c686 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:25.111208 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c283b027-549b-4b86-b6c6-c2a1cde2c686 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:25.192253 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c283b027-549b-4b86-b6c6-c2a1cde2c686 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 38187 microversion: 2.1 time: 0.094916 Aug 19 09:24:25.192873 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 520/1017] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:25 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 38187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:26.205196 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-09647d2e-9eb7-4c54-8b51-58146b879d91 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:26.206184 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-09647d2e-9eb7-4c54-8b51-58146b879d91 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:26.212575 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-09647d2e-9eb7-4c54-8b51-58146b879d91 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:26.213021 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-09647d2e-9eb7-4c54-8b51-58146b879d91 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:26.213782 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-09647d2e-9eb7-4c54-8b51-58146b879d91 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:26.214211 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-09647d2e-9eb7-4c54-8b51-58146b879d91 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:26.299767 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-09647d2e-9eb7-4c54-8b51-58146b879d91 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 38187 microversion: 2.1 time: 0.099164 Aug 19 09:24:26.300388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 498/1018] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:26 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 38187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:27.311467 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-24e6978c-43c0-4cbd-9636-95f4415f3a8e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:27.312461 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-24e6978c-43c0-4cbd-9636-95f4415f3a8e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:27.318824 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-24e6978c-43c0-4cbd-9636-95f4415f3a8e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:27.319289 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-24e6978c-43c0-4cbd-9636-95f4415f3a8e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:27.320060 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-24e6978c-43c0-4cbd-9636-95f4415f3a8e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:27.320491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-24e6978c-43c0-4cbd-9636-95f4415f3a8e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:27.402874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-24e6978c-43c0-4cbd-9636-95f4415f3a8e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 38187 microversion: 2.1 time: 0.095417 Aug 19 09:24:27.404179 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 521/1019] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:27 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 38187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:24:28.415777 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2608e988-f731-4001-8c72-9b038021567a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:28.416773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2608e988-f731-4001-8c72-9b038021567a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:28.423720 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2608e988-f731-4001-8c72-9b038021567a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:28.424175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2608e988-f731-4001-8c72-9b038021567a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:28.424938 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2608e988-f731-4001-8c72-9b038021567a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:28.425371 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2608e988-f731-4001-8c72-9b038021567a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:28.522657 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2608e988-f731-4001-8c72-9b038021567a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 200 len: 38318 microversion: 2.1 time: 0.110858 Aug 19 09:24:28.523574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 499/1020] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:28 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 38318 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:28.533534 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a00cfe5f-7a37-4516-973a-a4b01d71091a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:28.534102 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a00cfe5f-7a37-4516-973a-a4b01d71091a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:28.540427 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a00cfe5f-7a37-4516-973a-a4b01d71091a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:28.540869 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a00cfe5f-7a37-4516-973a-a4b01d71091a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:28.541619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a00cfe5f-7a37-4516-973a-a4b01d71091a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:28.542044 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a00cfe5f-7a37-4516-973a-a4b01d71091a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:28.565105 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a00cfe5f-7a37-4516-973a-a4b01d71091a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/ips" status: 200 len: 146 microversion: 2.1 time: 0.035602 Aug 19 09:24:28.565721 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 522/1021] 10.222.0.32 () {58 vars in 1248 bytes} [Thu Aug 19 09:24:28 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:24:30.750235 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7f4917c0-c7e8-4e2f-b82b-d9288c4e2c68 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bff0d387-2e87-4eb7-98eb-d037dca9da7f"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:30.751386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7f4917c0-c7e8-4e2f-b82b-d9288c4e2c68 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:30.757739 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f4917c0-c7e8-4e2f-b82b-d9288c4e2c68 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:30.758183 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f4917c0-c7e8-4e2f-b82b-d9288c4e2c68 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:30.758942 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f4917c0-c7e8-4e2f-b82b-d9288c4e2c68 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:30.759404 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f4917c0-c7e8-4e2f-b82b-d9288c4e2c68 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:31.004514 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7f4917c0-c7e8-4e2f-b82b-d9288c4e2c68 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258896 Aug 19 09:24:31.005112 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 500/1022] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:24:30 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:24:38.507088 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-04ec4709-7fa6-495b-8b16-9c55e72642fe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:38.513279 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-04ec4709-7fa6-495b-8b16-9c55e72642fe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:38.513789 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-04ec4709-7fa6-495b-8b16-9c55e72642fe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:38.571904 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-04ec4709-7fa6-495b-8b16-9c55e72642fe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Going to try to stop instance {{(pid=107957) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 19 09:24:38.612494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-04ec4709-7fa6-495b-8b16-9c55e72642fe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 202 len: 0 microversion: 2.1 time: 0.108921 Aug 19 09:24:38.613117 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 523/1023] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:38 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:24:38.621866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ef8307be-aeff-4f13-99e3-f5475e1a5b40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:38.622567 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ef8307be-aeff-4f13-99e3-f5475e1a5b40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:38.629209 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef8307be-aeff-4f13-99e3-f5475e1a5b40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:38.629625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef8307be-aeff-4f13-99e3-f5475e1a5b40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:38.630412 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef8307be-aeff-4f13-99e3-f5475e1a5b40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:38.630794 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ef8307be-aeff-4f13-99e3-f5475e1a5b40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:38.753321 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ef8307be-aeff-4f13-99e3-f5475e1a5b40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:38.761001 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ef8307be-aeff-4f13-99e3-f5475e1a5b40 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.143576 Aug 19 09:24:38.761561 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 501/1024] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:38 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:39.779172 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-38e683a9-d843-43c5-b4a6-16f7399cb3d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:39.779805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-38e683a9-d843-43c5-b4a6-16f7399cb3d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:39.785746 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38e683a9-d843-43c5-b4a6-16f7399cb3d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:39.786186 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38e683a9-d843-43c5-b4a6-16f7399cb3d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:39.786937 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38e683a9-d843-43c5-b4a6-16f7399cb3d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:39.787391 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-38e683a9-d843-43c5-b4a6-16f7399cb3d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:39.905541 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-38e683a9-d843-43c5-b4a6-16f7399cb3d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:39.913036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-38e683a9-d843-43c5-b4a6-16f7399cb3d2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.137980 Aug 19 09:24:39.913586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 524/1025] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:39 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:40.930459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7db7c477-c362-497b-af03-dd33e6427729 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:40.931155 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7db7c477-c362-497b-af03-dd33e6427729 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:40.937827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7db7c477-c362-497b-af03-dd33e6427729 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:40.938274 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7db7c477-c362-497b-af03-dd33e6427729 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:40.939062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7db7c477-c362-497b-af03-dd33e6427729 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:40.939517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7db7c477-c362-497b-af03-dd33e6427729 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:41.055685 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7db7c477-c362-497b-af03-dd33e6427729 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:41.063712 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7db7c477-c362-497b-af03-dd33e6427729 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.137058 Aug 19 09:24:41.064269 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 502/1026] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:40 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:24:42.081197 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c3b5e3f9-e0b8-4910-b337-4d0b9273e7ef tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:42.081792 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c3b5e3f9-e0b8-4910-b337-4d0b9273e7ef tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:42.088145 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c3b5e3f9-e0b8-4910-b337-4d0b9273e7ef tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:42.088527 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c3b5e3f9-e0b8-4910-b337-4d0b9273e7ef tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:42.089275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c3b5e3f9-e0b8-4910-b337-4d0b9273e7ef tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:42.089701 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c3b5e3f9-e0b8-4910-b337-4d0b9273e7ef tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:42.212757 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c3b5e3f9-e0b8-4910-b337-4d0b9273e7ef tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:42.221043 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c3b5e3f9-e0b8-4910-b337-4d0b9273e7ef tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.143459 Aug 19 09:24:42.221597 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 525/1027] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:42 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:42.668905 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7c964b9b-e52e-4ebd-8baa-ef7b5dc3e5d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:42.669411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7c964b9b-e52e-4ebd-8baa-ef7b5dc3e5d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:42.675027 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c964b9b-e52e-4ebd-8baa-ef7b5dc3e5d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:42.675505 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c964b9b-e52e-4ebd-8baa-ef7b5dc3e5d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:42.676257 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c964b9b-e52e-4ebd-8baa-ef7b5dc3e5d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:42.676682 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c964b9b-e52e-4ebd-8baa-ef7b5dc3e5d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:42.704825 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7c964b9b-e52e-4ebd-8baa-ef7b5dc3e5d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-volume_attachments/efaa1bff-27db-4cf7-bdc7-2c313ee7521b" status: 200 len: 194 microversion: 2.20 time: 0.039838 Aug 19 09:24:42.705373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 503/1028] 10.222.0.32 () {60 vars in 1454 bytes} [Thu Aug 19 09:24:42 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-volume_attachments/efaa1bff-27db-4cf7-bdc7-2c313ee7521b => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:42.769454 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fa524d69-38b3-4360-bba6-c73da000000d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:42.769944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fa524d69-38b3-4360-bba6-c73da000000d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:42.775622 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa524d69-38b3-4360-bba6-c73da000000d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:42.776069 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa524d69-38b3-4360-bba6-c73da000000d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:42.776827 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa524d69-38b3-4360-bba6-c73da000000d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:42.777259 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa524d69-38b3-4360-bba6-c73da000000d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:42.858518 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-fa524d69-38b3-4360-bba6-c73da000000d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lazy-loading 'services' on Instance uuid 7ed06d0a-7ee6-4f00-b470-b19d7331667c {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:24:42.920589 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fa524d69-38b3-4360-bba6-c73da000000d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-volume_attachments/efaa1bff-27db-4cf7-bdc7-2c313ee7521b" status: 202 len: 0 microversion: 2.20 time: 0.154037 Aug 19 09:24:42.921146 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 526/1029] 10.222.0.32 () {60 vars in 1457 bytes} [Thu Aug 19 09:24:42 2021] DELETE /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-volume_attachments/efaa1bff-27db-4cf7-bdc7-2c313ee7521b => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:24:42.929427 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b17142fe-d560-4cc7-b6ce-1097372cb2eb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:42.930468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b17142fe-d560-4cc7-b6ce-1097372cb2eb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:42.943439 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b17142fe-d560-4cc7-b6ce-1097372cb2eb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:42.943970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b17142fe-d560-4cc7-b6ce-1097372cb2eb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:42.944818 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b17142fe-d560-4cc7-b6ce-1097372cb2eb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:42.945343 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b17142fe-d560-4cc7-b6ce-1097372cb2eb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:42.974926 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b17142fe-d560-4cc7-b6ce-1097372cb2eb tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049434 Aug 19 09:24:42.975507 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 504/1030] 10.222.0.32 () {60 vars in 1343 bytes} [Thu Aug 19 09:24:42 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:24:43.239219 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9343ae66-b63e-41a9-b3a0-26aa7b0f1e69 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:43.239855 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9343ae66-b63e-41a9-b3a0-26aa7b0f1e69 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:43.245916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9343ae66-b63e-41a9-b3a0-26aa7b0f1e69 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:43.246352 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9343ae66-b63e-41a9-b3a0-26aa7b0f1e69 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:43.247100 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9343ae66-b63e-41a9-b3a0-26aa7b0f1e69 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:43.247551 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9343ae66-b63e-41a9-b3a0-26aa7b0f1e69 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:43.366096 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9343ae66-b63e-41a9-b3a0-26aa7b0f1e69 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:43.374143 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9343ae66-b63e-41a9-b3a0-26aa7b0f1e69 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.138995 Aug 19 09:24:43.374701 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 527/1031] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:43 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:43.986977 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-767e7de7-7fe4-4133-9936-5323e91eb855 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:43.987932 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-767e7de7-7fe4-4133-9936-5323e91eb855 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:43.993549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-767e7de7-7fe4-4133-9936-5323e91eb855 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:43.993984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-767e7de7-7fe4-4133-9936-5323e91eb855 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:43.994727 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-767e7de7-7fe4-4133-9936-5323e91eb855 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:43.995148 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-767e7de7-7fe4-4133-9936-5323e91eb855 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:44.022005 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-767e7de7-7fe4-4133-9936-5323e91eb855 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.038919 Aug 19 09:24:44.022533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 505/1032] 10.222.0.32 () {60 vars in 1343 bytes} [Thu Aug 19 09:24:43 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:44.080904 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d2d1ab8e-b634-46f6-8ae7-f79d8919bf93 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:44.081394 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d2d1ab8e-b634-46f6-8ae7-f79d8919bf93 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:44.087139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d2d1ab8e-b634-46f6-8ae7-f79d8919bf93 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:44.087618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d2d1ab8e-b634-46f6-8ae7-f79d8919bf93 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:44.088370 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d2d1ab8e-b634-46f6-8ae7-f79d8919bf93 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:44.088798 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d2d1ab8e-b634-46f6-8ae7-f79d8919bf93 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:44.114831 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d2d1ab8e-b634-46f6-8ae7-f79d8919bf93 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Going to try to terminate instance {{(pid=107957) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:24:44.186073 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d2d1ab8e-b634-46f6-8ae7-f79d8919bf93 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 204 len: 0 microversion: 2.20 time: 0.108531 Aug 19 09:24:44.186650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 528/1033] 10.222.0.32 () {60 vars in 1280 bytes} [Thu Aug 19 09:24:44 2021] DELETE /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 19 09:24:44.194661 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-826d59dd-9f17-481e-b7b2-cdd6c2b4e819 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:44.195383 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-826d59dd-9f17-481e-b7b2-cdd6c2b4e819 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:44.201327 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-826d59dd-9f17-481e-b7b2-cdd6c2b4e819 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:44.201773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-826d59dd-9f17-481e-b7b2-cdd6c2b4e819 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:44.202529 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-826d59dd-9f17-481e-b7b2-cdd6c2b4e819 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:44.202965 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-826d59dd-9f17-481e-b7b2-cdd6c2b4e819 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:44.326537 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-826d59dd-9f17-481e-b7b2-cdd6c2b4e819 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:44.334329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-826d59dd-9f17-481e-b7b2-cdd6c2b4e819 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:44.335904 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-826d59dd-9f17-481e-b7b2-cdd6c2b4e819 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:44.337062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-826d59dd-9f17-481e-b7b2-cdd6c2b4e819 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.146007 Aug 19 09:24:44.337613 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 506/1034] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:44 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:44.391826 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-99b01e3f-c39c-4ca7-a1a7-da88c9ec0700 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:44.392545 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-99b01e3f-c39c-4ca7-a1a7-da88c9ec0700 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:44.398209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-99b01e3f-c39c-4ca7-a1a7-da88c9ec0700 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:44.398649 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-99b01e3f-c39c-4ca7-a1a7-da88c9ec0700 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:44.399435 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-99b01e3f-c39c-4ca7-a1a7-da88c9ec0700 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:44.399868 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-99b01e3f-c39c-4ca7-a1a7-da88c9ec0700 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:44.517225 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-99b01e3f-c39c-4ca7-a1a7-da88c9ec0700 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:44.524795 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-99b01e3f-c39c-4ca7-a1a7-da88c9ec0700 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.137543 Aug 19 09:24:44.525355 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 529/1035] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:44 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:45.358201 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-dbde0b0e-1139-42d2-a933-75ca4c08271c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:45.358725 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-dbde0b0e-1139-42d2-a933-75ca4c08271c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:45.364934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dbde0b0e-1139-42d2-a933-75ca4c08271c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:45.365383 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dbde0b0e-1139-42d2-a933-75ca4c08271c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:45.366147 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dbde0b0e-1139-42d2-a933-75ca4c08271c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:45.366585 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dbde0b0e-1139-42d2-a933-75ca4c08271c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:45.488962 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dbde0b0e-1139-42d2-a933-75ca4c08271c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:45.496562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dbde0b0e-1139-42d2-a933-75ca4c08271c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:45.498053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dbde0b0e-1139-42d2-a933-75ca4c08271c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:45.499185 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-dbde0b0e-1139-42d2-a933-75ca4c08271c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.145850 Aug 19 09:24:45.499776 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 507/1036] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:45 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:45.541468 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-dbb14477-1837-4c0d-a369-f0157812b298 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:45.542075 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-dbb14477-1837-4c0d-a369-f0157812b298 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:45.548429 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbb14477-1837-4c0d-a369-f0157812b298 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:45.548877 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbb14477-1837-4c0d-a369-f0157812b298 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:45.549634 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbb14477-1837-4c0d-a369-f0157812b298 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:45.550101 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbb14477-1837-4c0d-a369-f0157812b298 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:45.668451 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dbb14477-1837-4c0d-a369-f0157812b298 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:45.676736 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-dbb14477-1837-4c0d-a369-f0157812b298 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.138887 Aug 19 09:24:45.677288 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 530/1037] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:45 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:46.517482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f53f2fab-84d7-4893-aea8-3f9eab0f5d41 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:46.518038 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f53f2fab-84d7-4893-aea8-3f9eab0f5d41 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:46.523983 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f53f2fab-84d7-4893-aea8-3f9eab0f5d41 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:46.524428 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f53f2fab-84d7-4893-aea8-3f9eab0f5d41 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:46.525198 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f53f2fab-84d7-4893-aea8-3f9eab0f5d41 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:46.525634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f53f2fab-84d7-4893-aea8-3f9eab0f5d41 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:46.693325 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ee810b90-9e51-4ab4-8256-a60b31749289 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:46.693972 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ee810b90-9e51-4ab4-8256-a60b31749289 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:46.699916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ee810b90-9e51-4ab4-8256-a60b31749289 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:46.700352 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ee810b90-9e51-4ab4-8256-a60b31749289 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:46.701143 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ee810b90-9e51-4ab4-8256-a60b31749289 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:46.701571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ee810b90-9e51-4ab4-8256-a60b31749289 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:46.818289 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ee810b90-9e51-4ab4-8256-a60b31749289 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:46.826510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ee810b90-9e51-4ab4-8256-a60b31749289 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.136773 Aug 19 09:24:46.827234 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 531/1038] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:46 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:46.859670 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f53f2fab-84d7-4893-aea8-3f9eab0f5d41 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:46.867157 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f53f2fab-84d7-4893-aea8-3f9eab0f5d41 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:46.868682 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f53f2fab-84d7-4893-aea8-3f9eab0f5d41 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:46.869813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f53f2fab-84d7-4893-aea8-3f9eab0f5d41 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 200 len: 1725 microversion: 2.20 time: 0.356195 Aug 19 09:24:46.870361 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 508/1039] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:46 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 1725 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:47.286720 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-3be985de-e366-4f2a-ba5a-e1558370462b req-8c39ace3-83db-4bdc-b94a-34642bc33834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed06d0a-7ee6-4f00-b470-b19d7331667c", "name": "network-vif-deleted", "tag": "137293e7-3590-4eee-8e9a-b01076e25605"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:47.293854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:24:47.293854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:24:47.305291 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-3be985de-e366-4f2a-ba5a-e1558370462b req-8c39ace3-83db-4bdc-b94a-34642bc33834 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:47.305841 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-3be985de-e366-4f2a-ba5a-e1558370462b req-8c39ace3-83db-4bdc-b94a-34642bc33834 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:47.318054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-3be985de-e366-4f2a-ba5a-e1558370462b req-8c39ace3-83db-4bdc-b94a-34642bc33834 service nova] Creating event network-vif-deleted:137293e7-3590-4eee-8e9a-b01076e25605 for instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c on hv-cinder-77387 Aug 19 09:24:47.324720 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-3be985de-e366-4f2a-ba5a-e1558370462b req-8c39ace3-83db-4bdc-b94a-34642bc33834 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041377 Aug 19 09:24:47.326528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 532/1040] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:24:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:24:47.844576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-379045b1-f8dc-4b0e-9547-fecfbefa91f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:47.846037 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-379045b1-f8dc-4b0e-9547-fecfbefa91f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:47.853559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-379045b1-f8dc-4b0e-9547-fecfbefa91f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:47.854424 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-379045b1-f8dc-4b0e-9547-fecfbefa91f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:47.855639 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-379045b1-f8dc-4b0e-9547-fecfbefa91f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:47.856341 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-379045b1-f8dc-4b0e-9547-fecfbefa91f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:47.891646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-bb274924-7019-4d7f-b942-18ebcec33cac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:47.892453 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-bb274924-7019-4d7f-b942-18ebcec33cac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:47.899234 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb274924-7019-4d7f-b942-18ebcec33cac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:47.905265 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb274924-7019-4d7f-b942-18ebcec33cac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:47.906260 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb274924-7019-4d7f-b942-18ebcec33cac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:47.907854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb274924-7019-4d7f-b942-18ebcec33cac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:47.929966 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-bb274924-7019-4d7f-b942-18ebcec33cac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] HTTP exception thrown: Instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c could not be found. Aug 19 09:24:47.930934 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-bb274924-7019-4d7f-b942-18ebcec33cac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Returning 404 to user: Instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:24:47.932160 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-bb274924-7019-4d7f-b942-18ebcec33cac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 404 len: 111 microversion: 2.20 time: 0.046321 Aug 19 09:24:47.932917 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 533/1041] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:47 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 09:24:47.947966 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-77e91f3a-7569-47c0-aea1-513d935c4e4b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '.version_select at 0x7fdb80d4ee50>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:48.017071 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-77e91f3a-7569-47c0-aea1-513d935c4e4b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809302607" status: 204 len: 0 microversion: 2.20 time: 0.072588 Aug 19 09:24:48.022148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 534/1042] 10.222.0.32 () {60 vars in 1262 bytes} [Thu Aug 19 09:24:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809302607 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 19 09:24:48.031436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-379045b1-f8dc-4b0e-9547-fecfbefa91f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:48.042252 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-379045b1-f8dc-4b0e-9547-fecfbefa91f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.201801 Aug 19 09:24:48.051792 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 509/1043] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:47 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:48.750702 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1a75aaff-2f9e-4042-a142-384f3ced5e7b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'create', calling method: .version_select at 0x7fdb80cf19d0>, body: {"keypair": {"name": "tempest-keypair-943878003"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:48.780325 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-1a75aaff-2f9e-4042-a142-384f3ced5e7b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for project 0a913122239e44edb71a2fd07a99b275. Resources: {'key_pairs'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:24:48.784458 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-1a75aaff-2f9e-4042-a142-384f3ced5e7b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for user 90d8d5eeacf74470bd13713074a281db and project 0a913122239e44edb71a2fd07a99b275. Resources: {'key_pairs'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:24:49.021805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-1a75aaff-2f9e-4042-a142-384f3ced5e7b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for project 0a913122239e44edb71a2fd07a99b275. Resources: {'key_pairs'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:24:49.025431 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-1a75aaff-2f9e-4042-a142-384f3ced5e7b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for user 90d8d5eeacf74470bd13713074a281db and project 0a913122239e44edb71a2fd07a99b275. Resources: {'key_pairs'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:24:49.038990 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1a75aaff-2f9e-4042-a142-384f3ced5e7b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.292547 Aug 19 09:24:49.039626 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 535/1044] 10.222.0.32 () {62 vars in 1199 bytes} [Thu Aug 19 09:24:48 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 294 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 19 09:24:49.059057 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9c89f02e-fa29-4fab-91f2-d63533345585 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:49.059769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9c89f02e-fa29-4fab-91f2-d63533345585 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:49.065593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c89f02e-fa29-4fab-91f2-d63533345585 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:49.066085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c89f02e-fa29-4fab-91f2-d63533345585 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:49.066811 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c89f02e-fa29-4fab-91f2-d63533345585 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:49.067514 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c89f02e-fa29-4fab-91f2-d63533345585 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:49.197106 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9c89f02e-fa29-4fab-91f2-d63533345585 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:49.207607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9c89f02e-fa29-4fab-91f2-d63533345585 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.151752 Aug 19 09:24:49.211533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 510/1045] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:49 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:50.225893 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2b2f006e-523e-42e4-a161-172b8739c143 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:50.227205 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2b2f006e-523e-42e4-a161-172b8739c143 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:50.234368 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2b2f006e-523e-42e4-a161-172b8739c143 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:50.234818 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2b2f006e-523e-42e4-a161-172b8739c143 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:50.235629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2b2f006e-523e-42e4-a161-172b8739c143 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:50.236106 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2b2f006e-523e-42e4-a161-172b8739c143 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:50.512437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2b2f006e-523e-42e4-a161-172b8739c143 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:50.521082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2b2f006e-523e-42e4-a161-172b8739c143 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.299304 Aug 19 09:24:50.521731 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 536/1046] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:50 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:24:50.567660 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-277603359", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20ee0fa8-4951-43ba-b13c-ba279ba12aa3"}], "security_groups": [{"name": "tempest-securitygroup--1021734195"}], "key_name": "tempest-keypair-943878003", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:50.657444 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.network.neutron [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] validate_networks() for [('20ee0fa8-4951-43ba-b13c-ba279ba12aa3', None, None, None, None, None)] {{(pid=107958) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:24:51.010860 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Flavor limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:24:51.011313 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Image limits 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:24:51.011784 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Flavor pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:24:51.012189 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Image pref 0:0:0 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:24:51.012600 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.virt.hardware [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:24:51.021600 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:51.022043 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:51.022829 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:51.023258 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:51.039589 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for project 0a913122239e44edb71a2fd07a99b275. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:24:51.043426 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Getting quotas for user 90d8d5eeacf74470bd13713074a281db and project 0a913122239e44edb71a2fd07a99b275. Resources: {'cores', 'ram', 'instances'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:24:51.054316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Going to run 1 instances... {{(pid=107958) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:24:51.056597 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:24:51.102570 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-20d6cf50-4438-4e85-ab8f-c23b19902870 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.538845 Aug 19 09:24:51.103207 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 511/1047] 10.222.0.32 () {62 vars in 1188 bytes} [Thu Aug 19 09:24:50 2021] POST /compute/v2.1/servers => generated 402 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 19 09:24:51.114000 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-98e34a83-6e56-4554-9756-b8b82bc7b34b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:51.114612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-98e34a83-6e56-4554-9756-b8b82bc7b34b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:51.164862 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-98e34a83-6e56-4554-9756-b8b82bc7b34b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:51.173453 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-98e34a83-6e56-4554-9756-b8b82bc7b34b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:51.175054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-98e34a83-6e56-4554-9756-b8b82bc7b34b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:51.176314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-98e34a83-6e56-4554-9756-b8b82bc7b34b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1280 microversion: 2.20 time: 0.065989 Aug 19 09:24:51.176989 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 537/1048] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:51 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:51.538541 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-18a9a388-83bb-4114-8331-8125616ef7a4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:51.539068 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-18a9a388-83bb-4114-8331-8125616ef7a4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:51.545573 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-18a9a388-83bb-4114-8331-8125616ef7a4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:51.546046 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-18a9a388-83bb-4114-8331-8125616ef7a4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:51.546802 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-18a9a388-83bb-4114-8331-8125616ef7a4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:51.547261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-18a9a388-83bb-4114-8331-8125616ef7a4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:51.665743 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-18a9a388-83bb-4114-8331-8125616ef7a4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:51.673507 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-18a9a388-83bb-4114-8331-8125616ef7a4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.138803 Aug 19 09:24:51.674076 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 512/1049] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:51 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:52.194564 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c9af38ff-fda6-4d52-b9ea-bae98249ff1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:52.195168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c9af38ff-fda6-4d52-b9ea-bae98249ff1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:52.201600 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c9af38ff-fda6-4d52-b9ea-bae98249ff1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:52.202059 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c9af38ff-fda6-4d52-b9ea-bae98249ff1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:52.202791 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c9af38ff-fda6-4d52-b9ea-bae98249ff1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:52.203217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c9af38ff-fda6-4d52-b9ea-bae98249ff1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:52.266124 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c9af38ff-fda6-4d52-b9ea-bae98249ff1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:52.273824 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c9af38ff-fda6-4d52-b9ea-bae98249ff1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:52.275361 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c9af38ff-fda6-4d52-b9ea-bae98249ff1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:52.276432 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c9af38ff-fda6-4d52-b9ea-bae98249ff1d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1338 microversion: 2.20 time: 0.085573 Aug 19 09:24:52.276971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 538/1050] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:52 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1338 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:52.695748 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-de284830-241d-4166-9e86-6257036bd9ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:52.696409 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-de284830-241d-4166-9e86-6257036bd9ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:52.702373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-de284830-241d-4166-9e86-6257036bd9ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:52.702823 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-de284830-241d-4166-9e86-6257036bd9ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:52.703644 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-de284830-241d-4166-9e86-6257036bd9ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:52.704080 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-de284830-241d-4166-9e86-6257036bd9ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:52.899431 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-de284830-241d-4166-9e86-6257036bd9ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:52.907171 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-de284830-241d-4166-9e86-6257036bd9ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.215070 Aug 19 09:24:52.907762 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 513/1051] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:52 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:53.293724 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f490211b-9129-4b41-9dd5-806f8b50fde3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:53.294946 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f490211b-9129-4b41-9dd5-806f8b50fde3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:53.301328 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f490211b-9129-4b41-9dd5-806f8b50fde3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:53.301778 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f490211b-9129-4b41-9dd5-806f8b50fde3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:53.302548 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f490211b-9129-4b41-9dd5-806f8b50fde3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:53.303153 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f490211b-9129-4b41-9dd5-806f8b50fde3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:53.434405 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f490211b-9129-4b41-9dd5-806f8b50fde3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:53.442802 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f490211b-9129-4b41-9dd5-806f8b50fde3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:53.444318 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f490211b-9129-4b41-9dd5-806f8b50fde3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:53.445384 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f490211b-9129-4b41-9dd5-806f8b50fde3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1406 microversion: 2.20 time: 0.155379 Aug 19 09:24:53.445932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 539/1052] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:53 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:53.479372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-aa6abfbf-b862-44cb-9f66-e3d714f0643c req-7036c568-ad65-4fc3-8728-7901edb0edcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89098f09-c8cd-4e15-bef5-1bc104634225", "tag": "c72c5439-5706-4605-91f9-225118f3705b"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:53.480954 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:24:53.480954 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:24:53.492332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-aa6abfbf-b862-44cb-9f66-e3d714f0643c req-7036c568-ad65-4fc3-8728-7901edb0edcd service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:53.493161 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-aa6abfbf-b862-44cb-9f66-e3d714f0643c req-7036c568-ad65-4fc3-8728-7901edb0edcd service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:53.507377 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-aa6abfbf-b862-44cb-9f66-e3d714f0643c req-7036c568-ad65-4fc3-8728-7901edb0edcd service nova] Creating event network-changed:c72c5439-5706-4605-91f9-225118f3705b for instance 89098f09-c8cd-4e15-bef5-1bc104634225 on hv-cinder-77387 Aug 19 09:24:53.513439 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-aa6abfbf-b862-44cb-9f66-e3d714f0643c req-7036c568-ad65-4fc3-8728-7901edb0edcd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036997 Aug 19 09:24:53.514600 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 514/1053] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:24:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:24:53.924681 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2f2a4392-3686-4cff-b4fe-893a540cf4f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:53.925328 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2f2a4392-3686-4cff-b4fe-893a540cf4f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:53.930903 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2f2a4392-3686-4cff-b4fe-893a540cf4f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:53.931383 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2f2a4392-3686-4cff-b4fe-893a540cf4f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:53.932903 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2f2a4392-3686-4cff-b4fe-893a540cf4f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:53.933677 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2f2a4392-3686-4cff-b4fe-893a540cf4f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:54.056296 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2f2a4392-3686-4cff-b4fe-893a540cf4f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:54.064933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2f2a4392-3686-4cff-b4fe-893a540cf4f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.144166 Aug 19 09:24:54.065498 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 540/1054] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:53 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:24:54.463923 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0ba617aa-594d-481e-9c91-a60ce5f02cb0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:54.464620 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0ba617aa-594d-481e-9c91-a60ce5f02cb0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:54.471519 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ba617aa-594d-481e-9c91-a60ce5f02cb0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:54.471976 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ba617aa-594d-481e-9c91-a60ce5f02cb0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:54.472755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ba617aa-594d-481e-9c91-a60ce5f02cb0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:54.473189 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ba617aa-594d-481e-9c91-a60ce5f02cb0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:54.742934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0ba617aa-594d-481e-9c91-a60ce5f02cb0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:54.751614 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0ba617aa-594d-481e-9c91-a60ce5f02cb0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:54.753210 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0ba617aa-594d-481e-9c91-a60ce5f02cb0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:54.754303 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0ba617aa-594d-481e-9c91-a60ce5f02cb0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1406 microversion: 2.20 time: 0.294522 Aug 19 09:24:54.754981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 515/1055] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:54 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:55.082595 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-078428b6-9336-4635-a419-a4ecde54ca6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:55.083192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-078428b6-9336-4635-a419-a4ecde54ca6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:55.089358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-078428b6-9336-4635-a419-a4ecde54ca6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:55.089798 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-078428b6-9336-4635-a419-a4ecde54ca6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:55.090546 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-078428b6-9336-4635-a419-a4ecde54ca6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:55.091900 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-078428b6-9336-4635-a419-a4ecde54ca6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:55.211832 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-078428b6-9336-4635-a419-a4ecde54ca6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:55.219970 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-078428b6-9336-4635-a419-a4ecde54ca6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.141073 Aug 19 09:24:55.220539 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 541/1056] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:55 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:55.772024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-99d43887-fac8-417f-843e-65da57324143 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:55.772544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-99d43887-fac8-417f-843e-65da57324143 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:55.778383 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99d43887-fac8-417f-843e-65da57324143 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:55.779025 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99d43887-fac8-417f-843e-65da57324143 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:55.779839 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99d43887-fac8-417f-843e-65da57324143 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:55.780278 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99d43887-fac8-417f-843e-65da57324143 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:55.896872 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-99d43887-fac8-417f-843e-65da57324143 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:55.904678 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-99d43887-fac8-417f-843e-65da57324143 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:55.906175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-99d43887-fac8-417f-843e-65da57324143 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:55.907254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-99d43887-fac8-417f-843e-65da57324143 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1406 microversion: 2.20 time: 0.139050 Aug 19 09:24:55.907820 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 516/1057] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:55 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1406 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:56.237533 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2f472834-b374-4a3d-953a-0ad9b0076588 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:56.238140 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2f472834-b374-4a3d-953a-0ad9b0076588 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:56.243903 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2f472834-b374-4a3d-953a-0ad9b0076588 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:56.244342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2f472834-b374-4a3d-953a-0ad9b0076588 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:56.245092 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2f472834-b374-4a3d-953a-0ad9b0076588 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:56.245519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2f472834-b374-4a3d-953a-0ad9b0076588 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:56.368077 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2f472834-b374-4a3d-953a-0ad9b0076588 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:56.375884 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2f472834-b374-4a3d-953a-0ad9b0076588 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.141910 Aug 19 09:24:56.376440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 542/1058] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:56 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:56.925070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a712974b-9e24-4a86-82c0-76c02a8ba9d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:56.925709 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a712974b-9e24-4a86-82c0-76c02a8ba9d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:56.931533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a712974b-9e24-4a86-82c0-76c02a8ba9d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:56.931981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a712974b-9e24-4a86-82c0-76c02a8ba9d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:56.932739 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a712974b-9e24-4a86-82c0-76c02a8ba9d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:56.933170 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a712974b-9e24-4a86-82c0-76c02a8ba9d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:57.051341 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a712974b-9e24-4a86-82c0-76c02a8ba9d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:57.058866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a712974b-9e24-4a86-82c0-76c02a8ba9d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:57.061176 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-a712974b-9e24-4a86-82c0-76c02a8ba9d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:57.062249 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a712974b-9e24-4a86-82c0-76c02a8ba9d6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1406 microversion: 2.20 time: 0.140888 Aug 19 09:24:57.062800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 517/1059] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:56 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1406 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:57.392497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-06b90f73-09dc-451a-a36e-844990cba54b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:57.393131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-06b90f73-09dc-451a-a36e-844990cba54b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:57.398849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-06b90f73-09dc-451a-a36e-844990cba54b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:57.399311 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-06b90f73-09dc-451a-a36e-844990cba54b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:57.400064 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-06b90f73-09dc-451a-a36e-844990cba54b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:57.400487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-06b90f73-09dc-451a-a36e-844990cba54b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:57.516542 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-06b90f73-09dc-451a-a36e-844990cba54b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:57.524009 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-06b90f73-09dc-451a-a36e-844990cba54b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.135106 Aug 19 09:24:57.524572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 543/1060] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:57 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:58.079330 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-09f318d5-68ae-4397-b06b-cfdb73558cd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:58.079874 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-09f318d5-68ae-4397-b06b-cfdb73558cd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:58.085610 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-09f318d5-68ae-4397-b06b-cfdb73558cd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:58.086051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-09f318d5-68ae-4397-b06b-cfdb73558cd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:58.086805 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-09f318d5-68ae-4397-b06b-cfdb73558cd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:58.087232 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-09f318d5-68ae-4397-b06b-cfdb73558cd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:58.209542 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-09f318d5-68ae-4397-b06b-cfdb73558cd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:58.217568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-09f318d5-68ae-4397-b06b-cfdb73558cd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:58.219045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-09f318d5-68ae-4397-b06b-cfdb73558cd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:58.220140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-09f318d5-68ae-4397-b06b-cfdb73558cd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1406 microversion: 2.20 time: 0.144634 Aug 19 09:24:58.220685 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 518/1061] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:58 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:58.541480 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5e19b38e-553b-47c8-a633-237ba9adb532 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:58.542090 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5e19b38e-553b-47c8-a633-237ba9adb532 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:58.548429 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5e19b38e-553b-47c8-a633-237ba9adb532 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:58.548871 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5e19b38e-553b-47c8-a633-237ba9adb532 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:58.549668 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5e19b38e-553b-47c8-a633-237ba9adb532 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:58.550095 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5e19b38e-553b-47c8-a633-237ba9adb532 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:58.670875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5e19b38e-553b-47c8-a633-237ba9adb532 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:58.678468 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5e19b38e-553b-47c8-a633-237ba9adb532 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1724 microversion: 2.1 time: 0.140688 Aug 19 09:24:58.679029 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 544/1062] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:58 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:59.237632 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-74fa367e-c610-4009-8b45-a0f4f1d6fadc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:59.238232 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-74fa367e-c610-4009-8b45-a0f4f1d6fadc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:59.243964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74fa367e-c610-4009-8b45-a0f4f1d6fadc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:59.244445 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74fa367e-c610-4009-8b45-a0f4f1d6fadc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:59.245183 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74fa367e-c610-4009-8b45-a0f4f1d6fadc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:59.245605 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74fa367e-c610-4009-8b45-a0f4f1d6fadc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:59.362983 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-74fa367e-c610-4009-8b45-a0f4f1d6fadc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:59.370802 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-74fa367e-c610-4009-8b45-a0f4f1d6fadc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:59.373010 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-74fa367e-c610-4009-8b45-a0f4f1d6fadc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:59.374080 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-74fa367e-c610-4009-8b45-a0f4f1d6fadc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1406 microversion: 2.20 time: 0.140151 Aug 19 09:24:59.374625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 519/1063] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:24:59 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1406 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:24:59.695411 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-617bdf4d-b37b-4a66-a29b-4819c6cdb70b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:59.696024 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-617bdf4d-b37b-4a66-a29b-4819c6cdb70b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:59.702482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-617bdf4d-b37b-4a66-a29b-4819c6cdb70b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:59.702932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-617bdf4d-b37b-4a66-a29b-4819c6cdb70b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:59.703727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-617bdf4d-b37b-4a66-a29b-4819c6cdb70b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:59.704165 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-617bdf4d-b37b-4a66-a29b-4819c6cdb70b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:59.823560 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-617bdf4d-b37b-4a66-a29b-4819c6cdb70b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:24:59.831656 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-617bdf4d-b37b-4a66-a29b-4819c6cdb70b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1701 microversion: 2.1 time: 0.139843 Aug 19 09:24:59.832223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 545/1064] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:59 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1701 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:24:59.847824 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-59f9691b-bcc5-4a3e-a13d-ebe53655ab43 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:24:59.853732 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-59f9691b-bcc5-4a3e-a13d-ebe53655ab43 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:59.854176 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-59f9691b-bcc5-4a3e-a13d-ebe53655ab43 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:59.918402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-59f9691b-bcc5-4a3e-a13d-ebe53655ab43 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Going to try to start instance {{(pid=107958) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 19 09:24:59.965512 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-59f9691b-bcc5-4a3e-a13d-ebe53655ab43 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 202 len: 0 microversion: 2.1 time: 0.120949 Aug 19 09:24:59.966536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 520/1065] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:24:59 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:24:59.981218 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-726f9fac-04ae-463b-96fd-0775a6730ad7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:24:59.983430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-726f9fac-04ae-463b-96fd-0775a6730ad7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:24:59.992126 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-726f9fac-04ae-463b-96fd-0775a6730ad7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:59.992568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-726f9fac-04ae-463b-96fd-0775a6730ad7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:24:59.993344 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-726f9fac-04ae-463b-96fd-0775a6730ad7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:24:59.993911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-726f9fac-04ae-463b-96fd-0775a6730ad7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:00.048699 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-79626370-a8c9-493c-a082-801b30776c43 req-b646a31a-f075-4a97-9350-ae5199a94c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89098f09-c8cd-4e15-bef5-1bc104634225", "name": "network-vif-plugged", "status": "completed", "tag": "c72c5439-5706-4605-91f9-225118f3705b"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:00.050324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:25:00.050324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:25:00.057676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-79626370-a8c9-493c-a082-801b30776c43 req-b646a31a-f075-4a97-9350-ae5199a94c27 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:00.058124 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-79626370-a8c9-493c-a082-801b30776c43 req-b646a31a-f075-4a97-9350-ae5199a94c27 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:00.070393 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-79626370-a8c9-493c-a082-801b30776c43 req-b646a31a-f075-4a97-9350-ae5199a94c27 service nova] Creating event network-vif-plugged:c72c5439-5706-4605-91f9-225118f3705b for instance 89098f09-c8cd-4e15-bef5-1bc104634225 on hv-cinder-77387 Aug 19 09:25:00.076437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-79626370-a8c9-493c-a082-801b30776c43 req-b646a31a-f075-4a97-9350-ae5199a94c27 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151128 Aug 19 09:25:00.077027 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 546/1066] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:24:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:25:00.125476 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-726f9fac-04ae-463b-96fd-0775a6730ad7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:00.135078 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-726f9fac-04ae-463b-96fd-0775a6730ad7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1710 microversion: 2.1 time: 0.159011 Aug 19 09:25:00.135916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 521/1067] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:24:59 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:25:00.392465 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-22692cfc-7c92-4858-bb5c-30fbfb6956e4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:25:00.393180 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-22692cfc-7c92-4858-bb5c-30fbfb6956e4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:00.399052 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-22692cfc-7c92-4858-bb5c-30fbfb6956e4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:00.399523 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-22692cfc-7c92-4858-bb5c-30fbfb6956e4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:00.400278 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-22692cfc-7c92-4858-bb5c-30fbfb6956e4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:00.400704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-22692cfc-7c92-4858-bb5c-30fbfb6956e4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:00.519367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-22692cfc-7c92-4858-bb5c-30fbfb6956e4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:00.526864 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-22692cfc-7c92-4858-bb5c-30fbfb6956e4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:00.528874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-22692cfc-7c92-4858-bb5c-30fbfb6956e4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:00.529933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-22692cfc-7c92-4858-bb5c-30fbfb6956e4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1406 microversion: 2.20 time: 0.141634 Aug 19 09:25:00.530482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 547/1068] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:25:00 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:25:01.151939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ff2ba802-41f1-4ee2-affc-0b5fd1d340bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:25:01.152558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ff2ba802-41f1-4ee2-affc-0b5fd1d340bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:01.158326 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff2ba802-41f1-4ee2-affc-0b5fd1d340bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:01.158779 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff2ba802-41f1-4ee2-affc-0b5fd1d340bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:01.159559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff2ba802-41f1-4ee2-affc-0b5fd1d340bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:01.160008 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff2ba802-41f1-4ee2-affc-0b5fd1d340bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:01.277337 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ff2ba802-41f1-4ee2-affc-0b5fd1d340bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:01.285388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ff2ba802-41f1-4ee2-affc-0b5fd1d340bc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1710 microversion: 2.1 time: 0.137114 Aug 19 09:25:01.285951 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 522/1069] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:25:01 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1710 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:01.547551 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ab9062af-d411-4c6f-a4fc-303fd873c7cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:25:01.548143 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ab9062af-d411-4c6f-a4fc-303fd873c7cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:01.553943 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ab9062af-d411-4c6f-a4fc-303fd873c7cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:01.554384 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ab9062af-d411-4c6f-a4fc-303fd873c7cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:01.555132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ab9062af-d411-4c6f-a4fc-303fd873c7cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:01.555587 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ab9062af-d411-4c6f-a4fc-303fd873c7cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:01.675529 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ab9062af-d411-4c6f-a4fc-303fd873c7cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:01.683194 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ab9062af-d411-4c6f-a4fc-303fd873c7cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:01.685401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ab9062af-d411-4c6f-a4fc-303fd873c7cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:01.686437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ab9062af-d411-4c6f-a4fc-303fd873c7cc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1406 microversion: 2.20 time: 0.143184 Aug 19 09:25:01.686986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 548/1070] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:25:01 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1406 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:25:02.302947 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b515c57c-4ef3-479e-90dc-5f06be58acde tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:25:02.303632 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b515c57c-4ef3-479e-90dc-5f06be58acde tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:02.309316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b515c57c-4ef3-479e-90dc-5f06be58acde tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:02.309765 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b515c57c-4ef3-479e-90dc-5f06be58acde tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:02.310668 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b515c57c-4ef3-479e-90dc-5f06be58acde tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:02.311121 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b515c57c-4ef3-479e-90dc-5f06be58acde tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:02.429018 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b515c57c-4ef3-479e-90dc-5f06be58acde tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:02.436671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b515c57c-4ef3-479e-90dc-5f06be58acde tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1714 microversion: 2.1 time: 0.137362 Aug 19 09:25:02.437227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 523/1071] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:25:02 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1714 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:02.704324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5227de6e-13a4-46b7-8f83-abffaa887055 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:25:02.704925 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5227de6e-13a4-46b7-8f83-abffaa887055 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:02.710918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5227de6e-13a4-46b7-8f83-abffaa887055 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:02.711392 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5227de6e-13a4-46b7-8f83-abffaa887055 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:02.712211 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5227de6e-13a4-46b7-8f83-abffaa887055 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:02.712646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5227de6e-13a4-46b7-8f83-abffaa887055 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:02.830285 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5227de6e-13a4-46b7-8f83-abffaa887055 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:02.838358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5227de6e-13a4-46b7-8f83-abffaa887055 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:02.839936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5227de6e-13a4-46b7-8f83-abffaa887055 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:25:02.841278 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5227de6e-13a4-46b7-8f83-abffaa887055 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1598 microversion: 2.20 time: 0.140982 Aug 19 09:25:02.842050 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 549/1072] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:25:02 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1598 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:25:02.858734 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8ec25be5-a008-4edd-8975-bd299942f16a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:25:02.859230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8ec25be5-a008-4edd-8975-bd299942f16a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:02.865039 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ec25be5-a008-4edd-8975-bd299942f16a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:02.865487 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ec25be5-a008-4edd-8975-bd299942f16a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:02.866244 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ec25be5-a008-4edd-8975-bd299942f16a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:02.866707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8ec25be5-a008-4edd-8975-bd299942f16a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:02.953278 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8ec25be5-a008-4edd-8975-bd299942f16a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098299 Aug 19 09:25:02.953875 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 524/1073] 10.222.0.32 () {60 vars in 1316 bytes} [Thu Aug 19 09:25:02 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:25:04.077516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5f36844a-fcb8-40af-9b6a-a13ef4468374 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:04.078452 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5f36844a-fcb8-40af-9b6a-a13ef4468374 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:04.079559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-67d5a0f9-63d8-440e-8bca-ead78833c712 req-d1b07977-3ce5-4f20-be76-f3a2ddf44e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89098f09-c8cd-4e15-bef5-1bc104634225", "tag": "c72c5439-5706-4605-91f9-225118f3705b"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:04.081130 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:25:04.081130 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:25:04.084484 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f36844a-fcb8-40af-9b6a-a13ef4468374 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:04.084932 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f36844a-fcb8-40af-9b6a-a13ef4468374 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:04.085890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f36844a-fcb8-40af-9b6a-a13ef4468374 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:04.086328 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5f36844a-fcb8-40af-9b6a-a13ef4468374 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:04.089092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-67d5a0f9-63d8-440e-8bca-ead78833c712 req-d1b07977-3ce5-4f20-be76-f3a2ddf44e0d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:04.089609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-67d5a0f9-63d8-440e-8bca-ead78833c712 req-d1b07977-3ce5-4f20-be76-f3a2ddf44e0d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:04.102423 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-67d5a0f9-63d8-440e-8bca-ead78833c712 req-d1b07977-3ce5-4f20-be76-f3a2ddf44e0d service nova] Creating event network-changed:c72c5439-5706-4605-91f9-225118f3705b for instance 89098f09-c8cd-4e15-bef5-1bc104634225 on hv-cinder-77387 Aug 19 09:25:04.108449 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-67d5a0f9-63d8-440e-8bca-ead78833c712 req-d1b07977-3ce5-4f20-be76-f3a2ddf44e0d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032814 Aug 19 09:25:04.109456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 525/1074] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:25:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:25:04.196693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5f36844a-fcb8-40af-9b6a-a13ef4468374 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 14 microversion: 2.20 time: 0.123391 Aug 19 09:25:04.197508 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 550/1075] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:04 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:05.208012 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c11d51a0-ab4e-4eb5-aa7c-5a85a91dc5e9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:05.209017 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c11d51a0-ab4e-4eb5-aa7c-5a85a91dc5e9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:05.214959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c11d51a0-ab4e-4eb5-aa7c-5a85a91dc5e9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:05.215430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c11d51a0-ab4e-4eb5-aa7c-5a85a91dc5e9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:05.216922 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c11d51a0-ab4e-4eb5-aa7c-5a85a91dc5e9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:05.217354 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c11d51a0-ab4e-4eb5-aa7c-5a85a91dc5e9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:05.306303 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c11d51a0-ab4e-4eb5-aa7c-5a85a91dc5e9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 14 microversion: 2.20 time: 0.102159 Aug 19 09:25:05.306936 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 526/1076] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:05 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:06.317805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-01c1bd7c-a01f-401b-81ab-cb5969a19e0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:06.318718 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-01c1bd7c-a01f-401b-81ab-cb5969a19e0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:06.325652 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01c1bd7c-a01f-401b-81ab-cb5969a19e0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:06.326098 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01c1bd7c-a01f-401b-81ab-cb5969a19e0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:06.326887 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01c1bd7c-a01f-401b-81ab-cb5969a19e0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:06.327354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-01c1bd7c-a01f-401b-81ab-cb5969a19e0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:06.412326 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-01c1bd7c-a01f-401b-81ab-cb5969a19e0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 14 microversion: 2.20 time: 0.098521 Aug 19 09:25:06.412946 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 551/1077] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:06 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:07.423565 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f87b390f-5567-45e8-8228-699b91ba33ab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:07.424574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f87b390f-5567-45e8-8228-699b91ba33ab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:07.431623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f87b390f-5567-45e8-8228-699b91ba33ab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:07.432065 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f87b390f-5567-45e8-8228-699b91ba33ab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:07.432823 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f87b390f-5567-45e8-8228-699b91ba33ab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:07.433253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f87b390f-5567-45e8-8228-699b91ba33ab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:07.510258 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f87b390f-5567-45e8-8228-699b91ba33ab tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 14 microversion: 2.20 time: 0.090601 Aug 19 09:25:07.510855 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 527/1078] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:07 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:08.521800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-022ff9eb-bda9-4a0d-9ca8-e3e829527a69 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:08.522783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-022ff9eb-bda9-4a0d-9ca8-e3e829527a69 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:08.529288 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-022ff9eb-bda9-4a0d-9ca8-e3e829527a69 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:08.529727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-022ff9eb-bda9-4a0d-9ca8-e3e829527a69 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:08.530482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-022ff9eb-bda9-4a0d-9ca8-e3e829527a69 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:08.530909 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-022ff9eb-bda9-4a0d-9ca8-e3e829527a69 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:08.632397 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-022ff9eb-bda9-4a0d-9ca8-e3e829527a69 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 14 microversion: 2.20 time: 0.114381 Aug 19 09:25:08.633096 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 552/1079] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:08 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:09.644449 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9f3db12d-6378-4c33-a94a-ff756dc62924 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:09.645357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9f3db12d-6378-4c33-a94a-ff756dc62924 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:09.651903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9f3db12d-6378-4c33-a94a-ff756dc62924 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:09.652351 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9f3db12d-6378-4c33-a94a-ff756dc62924 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:09.653151 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9f3db12d-6378-4c33-a94a-ff756dc62924 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:09.653587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9f3db12d-6378-4c33-a94a-ff756dc62924 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:09.740801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9f3db12d-6378-4c33-a94a-ff756dc62924 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 14 microversion: 2.20 time: 0.100336 Aug 19 09:25:09.741391 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 528/1080] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:09 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:10.752480 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8a440897-d3a2-42ee-b00a-b4337d4ddc9f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:10.753424 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8a440897-d3a2-42ee-b00a-b4337d4ddc9f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:10.759786 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8a440897-d3a2-42ee-b00a-b4337d4ddc9f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:10.760232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8a440897-d3a2-42ee-b00a-b4337d4ddc9f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:10.760986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8a440897-d3a2-42ee-b00a-b4337d4ddc9f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:10.761417 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8a440897-d3a2-42ee-b00a-b4337d4ddc9f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:10.857420 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8a440897-d3a2-42ee-b00a-b4337d4ddc9f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 14 microversion: 2.20 time: 0.108922 Aug 19 09:25:10.858002 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 553/1081] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:10 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:11.868528 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2875b480-dd02-47a9-a819-33ec94757e3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:11.869523 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2875b480-dd02-47a9-a819-33ec94757e3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:11.876174 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2875b480-dd02-47a9-a819-33ec94757e3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:11.876618 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2875b480-dd02-47a9-a819-33ec94757e3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:11.877382 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2875b480-dd02-47a9-a819-33ec94757e3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:11.877817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2875b480-dd02-47a9-a819-33ec94757e3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:11.994580 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2875b480-dd02-47a9-a819-33ec94757e3f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 14 microversion: 2.20 time: 0.129998 Aug 19 09:25:11.995184 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 529/1082] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:11 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:13.005145 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cb091816-bdfb-4955-86b1-58faf63e422d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:13.006131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cb091816-bdfb-4955-86b1-58faf63e422d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:13.012499 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb091816-bdfb-4955-86b1-58faf63e422d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:13.012943 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb091816-bdfb-4955-86b1-58faf63e422d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:13.013698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb091816-bdfb-4955-86b1-58faf63e422d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:13.014126 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb091816-bdfb-4955-86b1-58faf63e422d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:13.109938 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cb091816-bdfb-4955-86b1-58faf63e422d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 14 microversion: 2.20 time: 0.108634 Aug 19 09:25:13.110589 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 554/1083] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:12 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:25:14.121489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-72c36bc9-28ff-4d98-b215-fdb64916a7d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:14.123322 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-72c36bc9-28ff-4d98-b215-fdb64916a7d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:14.129570 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-72c36bc9-28ff-4d98-b215-fdb64916a7d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:14.130019 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-72c36bc9-28ff-4d98-b215-fdb64916a7d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:14.130789 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-72c36bc9-28ff-4d98-b215-fdb64916a7d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:14.131224 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-72c36bc9-28ff-4d98-b215-fdb64916a7d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:14.235868 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-72c36bc9-28ff-4d98-b215-fdb64916a7d9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 7043 microversion: 2.20 time: 0.118513 Aug 19 09:25:14.236484 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 530/1084] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:14 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 7043 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:25:15.247825 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0e9cd3db-9143-4ea0-83bd-9edfe2454f65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:15.248752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0e9cd3db-9143-4ea0-83bd-9edfe2454f65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:15.254828 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0e9cd3db-9143-4ea0-83bd-9edfe2454f65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:15.255294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0e9cd3db-9143-4ea0-83bd-9edfe2454f65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:15.256061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0e9cd3db-9143-4ea0-83bd-9edfe2454f65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:15.256489 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0e9cd3db-9143-4ea0-83bd-9edfe2454f65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:15.343973 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0e9cd3db-9143-4ea0-83bd-9edfe2454f65 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 15025 microversion: 2.20 time: 0.100583 Aug 19 09:25:15.344625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 555/1085] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:15 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 15025 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:16.355373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7c949ae4-6100-4b20-bfea-90ccd0363b61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:16.356744 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7c949ae4-6100-4b20-bfea-90ccd0363b61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:16.362837 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c949ae4-6100-4b20-bfea-90ccd0363b61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:16.363302 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c949ae4-6100-4b20-bfea-90ccd0363b61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:16.364085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c949ae4-6100-4b20-bfea-90ccd0363b61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:16.364520 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7c949ae4-6100-4b20-bfea-90ccd0363b61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:16.487814 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7c949ae4-6100-4b20-bfea-90ccd0363b61 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 18498 microversion: 2.20 time: 0.136296 Aug 19 09:25:16.488367 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 531/1086] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:16 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 18498 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:17.506456 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-631ec4e9-8d51-4cb5-8ade-4e09d346cfce tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:17.507464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-631ec4e9-8d51-4cb5-8ade-4e09d346cfce tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:17.514814 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-631ec4e9-8d51-4cb5-8ade-4e09d346cfce tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:17.515267 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-631ec4e9-8d51-4cb5-8ade-4e09d346cfce tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:17.516069 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-631ec4e9-8d51-4cb5-8ade-4e09d346cfce tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:17.516505 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-631ec4e9-8d51-4cb5-8ade-4e09d346cfce tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:17.621307 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-631ec4e9-8d51-4cb5-8ade-4e09d346cfce tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 20074 microversion: 2.20 time: 0.121555 Aug 19 09:25:17.622262 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 556/1087] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:17 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 20074 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:18.633498 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-99c7223e-0348-4d01-b463-5c5a76684494 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:18.634426 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-99c7223e-0348-4d01-b463-5c5a76684494 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:18.641773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99c7223e-0348-4d01-b463-5c5a76684494 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:18.642223 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99c7223e-0348-4d01-b463-5c5a76684494 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:18.642991 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99c7223e-0348-4d01-b463-5c5a76684494 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:18.643451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-99c7223e-0348-4d01-b463-5c5a76684494 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:18.737819 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-99c7223e-0348-4d01-b463-5c5a76684494 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 22716 microversion: 2.20 time: 0.108272 Aug 19 09:25:18.738446 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 532/1088] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:18 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 22716 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:19.749784 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9638e4e8-e03d-4940-adb1-ca06b62c7667 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:19.750701 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9638e4e8-e03d-4940-adb1-ca06b62c7667 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:19.757120 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9638e4e8-e03d-4940-adb1-ca06b62c7667 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:19.757568 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9638e4e8-e03d-4940-adb1-ca06b62c7667 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:19.758329 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9638e4e8-e03d-4940-adb1-ca06b62c7667 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:19.758761 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9638e4e8-e03d-4940-adb1-ca06b62c7667 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:19.851764 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9638e4e8-e03d-4940-adb1-ca06b62c7667 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 23803 microversion: 2.20 time: 0.105949 Aug 19 09:25:19.852601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 557/1089] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:19 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 23803 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:20.863786 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5977ecf2-a9cd-4947-ace1-1e4bcd68aa0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:20.864705 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5977ecf2-a9cd-4947-ace1-1e4bcd68aa0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:20.871097 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5977ecf2-a9cd-4947-ace1-1e4bcd68aa0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:20.871843 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5977ecf2-a9cd-4947-ace1-1e4bcd68aa0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:20.872615 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5977ecf2-a9cd-4947-ace1-1e4bcd68aa0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:20.873047 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5977ecf2-a9cd-4947-ace1-1e4bcd68aa0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:20.968331 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5977ecf2-a9cd-4947-ace1-1e4bcd68aa0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 25342 microversion: 2.20 time: 0.108561 Aug 19 09:25:20.968932 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 533/1090] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:20 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 25342 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:21.980460 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e851d174-eabf-47af-b1f8-ee15489661fa tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:21.982081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e851d174-eabf-47af-b1f8-ee15489661fa tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:21.988485 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e851d174-eabf-47af-b1f8-ee15489661fa tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:21.988933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e851d174-eabf-47af-b1f8-ee15489661fa tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:21.989689 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e851d174-eabf-47af-b1f8-ee15489661fa tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:21.990123 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e851d174-eabf-47af-b1f8-ee15489661fa tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:22.081460 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e851d174-eabf-47af-b1f8-ee15489661fa tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 26807 microversion: 2.20 time: 0.104894 Aug 19 09:25:22.082116 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 558/1091] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:21 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 26807 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:23.093433 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-825cb61b-146a-42e5-afa8-67274df7c462 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:23.094450 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-825cb61b-146a-42e5-afa8-67274df7c462 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:23.101105 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-825cb61b-146a-42e5-afa8-67274df7c462 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:23.101551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-825cb61b-146a-42e5-afa8-67274df7c462 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:23.102310 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-825cb61b-146a-42e5-afa8-67274df7c462 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:23.102742 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-825cb61b-146a-42e5-afa8-67274df7c462 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:23.195344 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-825cb61b-146a-42e5-afa8-67274df7c462 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 27632 microversion: 2.20 time: 0.106169 Aug 19 09:25:23.196041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 534/1092] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:23 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 27632 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:24.207531 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1840751b-b7d4-4679-9f95-533ccfdb337c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:24.208515 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1840751b-b7d4-4679-9f95-533ccfdb337c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:24.214858 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1840751b-b7d4-4679-9f95-533ccfdb337c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:24.215322 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1840751b-b7d4-4679-9f95-533ccfdb337c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:24.216834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1840751b-b7d4-4679-9f95-533ccfdb337c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:24.217263 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1840751b-b7d4-4679-9f95-533ccfdb337c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:24.326260 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1840751b-b7d4-4679-9f95-533ccfdb337c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 27926 microversion: 2.20 time: 0.122628 Aug 19 09:25:24.326863 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 559/1093] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:24 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 27926 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:25.337943 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3da99b87-d4c7-4f43-9306-46c84e9981e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:25.338923 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3da99b87-d4c7-4f43-9306-46c84e9981e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:25.346052 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3da99b87-d4c7-4f43-9306-46c84e9981e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:25.346495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3da99b87-d4c7-4f43-9306-46c84e9981e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:25.347247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3da99b87-d4c7-4f43-9306-46c84e9981e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:25.347707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3da99b87-d4c7-4f43-9306-46c84e9981e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:25.439070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3da99b87-d4c7-4f43-9306-46c84e9981e8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.105141 Aug 19 09:25:25.439752 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 535/1094] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:25 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:26.451055 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a7b780c3-91f9-4361-884d-a718d9e5c189 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:26.452060 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a7b780c3-91f9-4361-884d-a718d9e5c189 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:26.458398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a7b780c3-91f9-4361-884d-a718d9e5c189 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:26.458833 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a7b780c3-91f9-4361-884d-a718d9e5c189 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:26.459608 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a7b780c3-91f9-4361-884d-a718d9e5c189 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:26.460035 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a7b780c3-91f9-4361-884d-a718d9e5c189 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:26.543294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a7b780c3-91f9-4361-884d-a718d9e5c189 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.096133 Aug 19 09:25:26.544423 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 560/1095] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:26 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:27.555595 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-08d4e5f9-dbc0-4956-9977-469cc54875cd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:27.556574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-08d4e5f9-dbc0-4956-9977-469cc54875cd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:27.563448 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08d4e5f9-dbc0-4956-9977-469cc54875cd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:27.563890 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08d4e5f9-dbc0-4956-9977-469cc54875cd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:27.564640 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08d4e5f9-dbc0-4956-9977-469cc54875cd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:27.565068 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-08d4e5f9-dbc0-4956-9977-469cc54875cd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:27.650558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-08d4e5f9-dbc0-4956-9977-469cc54875cd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.098813 Aug 19 09:25:27.651081 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 536/1096] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:27 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:28.663843 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-67cc3039-311d-4a5c-af59-48a41680010f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:28.664758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-67cc3039-311d-4a5c-af59-48a41680010f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:28.671610 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-67cc3039-311d-4a5c-af59-48a41680010f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:28.672056 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-67cc3039-311d-4a5c-af59-48a41680010f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:28.672812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-67cc3039-311d-4a5c-af59-48a41680010f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:28.673238 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-67cc3039-311d-4a5c-af59-48a41680010f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:28.755567 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-67cc3039-311d-4a5c-af59-48a41680010f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.096867 Aug 19 09:25:28.756186 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 561/1097] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:28 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:29.768153 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0df8366c-5084-45f1-9486-6f790866d115 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:29.769097 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0df8366c-5084-45f1-9486-6f790866d115 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:29.775474 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0df8366c-5084-45f1-9486-6f790866d115 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:29.775930 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0df8366c-5084-45f1-9486-6f790866d115 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:29.776691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0df8366c-5084-45f1-9486-6f790866d115 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:29.777123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0df8366c-5084-45f1-9486-6f790866d115 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:29.862831 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0df8366c-5084-45f1-9486-6f790866d115 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.099309 Aug 19 09:25:29.863459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 537/1098] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:29 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:30.874786 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5152684a-e7c3-4cfa-883a-73cbc41507c7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:30.875805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5152684a-e7c3-4cfa-883a-73cbc41507c7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:30.882136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5152684a-e7c3-4cfa-883a-73cbc41507c7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:30.882577 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5152684a-e7c3-4cfa-883a-73cbc41507c7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:30.883355 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5152684a-e7c3-4cfa-883a-73cbc41507c7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:30.883793 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5152684a-e7c3-4cfa-883a-73cbc41507c7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:30.965415 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5152684a-e7c3-4cfa-883a-73cbc41507c7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.094603 Aug 19 09:25:30.966025 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 562/1099] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:30 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:31.978348 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4cc3fc5f-924e-45cf-a31e-d737ae074eac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:31.979386 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4cc3fc5f-924e-45cf-a31e-d737ae074eac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:31.986139 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4cc3fc5f-924e-45cf-a31e-d737ae074eac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:31.986575 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4cc3fc5f-924e-45cf-a31e-d737ae074eac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:31.987421 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4cc3fc5f-924e-45cf-a31e-d737ae074eac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:31.987856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4cc3fc5f-924e-45cf-a31e-d737ae074eac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:32.073465 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4cc3fc5f-924e-45cf-a31e-d737ae074eac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.098944 Aug 19 09:25:32.074096 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 538/1100] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:31 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:33.086038 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-85d72131-e827-4a38-b4d2-7c27d1276171 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:33.087036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-85d72131-e827-4a38-b4d2-7c27d1276171 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:33.094426 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-85d72131-e827-4a38-b4d2-7c27d1276171 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:33.094875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-85d72131-e827-4a38-b4d2-7c27d1276171 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:33.095666 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-85d72131-e827-4a38-b4d2-7c27d1276171 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:33.096100 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-85d72131-e827-4a38-b4d2-7c27d1276171 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:33.176778 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-85d72131-e827-4a38-b4d2-7c27d1276171 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.094646 Aug 19 09:25:33.177441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 563/1101] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:33 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:34.188763 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b8b532ea-5c2a-474e-9fbb-170fd7df648e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:34.189754 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b8b532ea-5c2a-474e-9fbb-170fd7df648e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:34.196186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b8b532ea-5c2a-474e-9fbb-170fd7df648e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:34.196636 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b8b532ea-5c2a-474e-9fbb-170fd7df648e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:34.197392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b8b532ea-5c2a-474e-9fbb-170fd7df648e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:34.197823 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b8b532ea-5c2a-474e-9fbb-170fd7df648e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:34.277650 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b8b532ea-5c2a-474e-9fbb-170fd7df648e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.092925 Aug 19 09:25:34.278253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 539/1102] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:34 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:35.291056 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fa597793-4a0f-4766-ba40-63c2c7dc93ea tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:35.292075 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fa597793-4a0f-4766-ba40-63c2c7dc93ea tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:35.298456 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa597793-4a0f-4766-ba40-63c2c7dc93ea tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:35.298907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa597793-4a0f-4766-ba40-63c2c7dc93ea tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:35.299695 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa597793-4a0f-4766-ba40-63c2c7dc93ea tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:35.300129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa597793-4a0f-4766-ba40-63c2c7dc93ea tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:35.393555 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fa597793-4a0f-4766-ba40-63c2c7dc93ea tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.106449 Aug 19 09:25:35.394195 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 564/1103] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:35 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:36.406218 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2d1fa813-7715-416b-972e-45f879b9f80a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:36.407287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2d1fa813-7715-416b-972e-45f879b9f80a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:36.413666 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2d1fa813-7715-416b-972e-45f879b9f80a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:36.414056 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2d1fa813-7715-416b-972e-45f879b9f80a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:36.414815 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2d1fa813-7715-416b-972e-45f879b9f80a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:36.415248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2d1fa813-7715-416b-972e-45f879b9f80a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:36.496489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2d1fa813-7715-416b-972e-45f879b9f80a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.094824 Aug 19 09:25:36.497122 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 540/1104] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:36 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:37.508508 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-58cc744c-8f1c-4c84-8da2-1a36e40c7f35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:37.509502 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-58cc744c-8f1c-4c84-8da2-1a36e40c7f35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:37.516476 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58cc744c-8f1c-4c84-8da2-1a36e40c7f35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:37.516919 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58cc744c-8f1c-4c84-8da2-1a36e40c7f35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:37.517678 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58cc744c-8f1c-4c84-8da2-1a36e40c7f35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:37.518110 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58cc744c-8f1c-4c84-8da2-1a36e40c7f35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:37.601644 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-58cc744c-8f1c-4c84-8da2-1a36e40c7f35 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28178 microversion: 2.20 time: 0.097024 Aug 19 09:25:37.602487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 565/1105] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:37 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28178 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:38.613562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-14b974c2-4262-4b36-ae38-a32884cc2a25 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:38.614546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-14b974c2-4262-4b36-ae38-a32884cc2a25 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:38.621082 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-14b974c2-4262-4b36-ae38-a32884cc2a25 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:38.621531 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-14b974c2-4262-4b36-ae38-a32884cc2a25 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:38.622291 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-14b974c2-4262-4b36-ae38-a32884cc2a25 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:38.622722 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-14b974c2-4262-4b36-ae38-a32884cc2a25 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:38.720482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-14b974c2-4262-4b36-ae38-a32884cc2a25 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28305 microversion: 2.20 time: 0.110825 Aug 19 09:25:38.721055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 541/1106] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:38 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:39.732678 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8c92b243-a4cd-499f-b0a2-90d8fbbdf718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:39.734306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8c92b243-a4cd-499f-b0a2-90d8fbbdf718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:39.740628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c92b243-a4cd-499f-b0a2-90d8fbbdf718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:39.741069 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c92b243-a4cd-499f-b0a2-90d8fbbdf718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:39.741820 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c92b243-a4cd-499f-b0a2-90d8fbbdf718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:39.742256 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8c92b243-a4cd-499f-b0a2-90d8fbbdf718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:39.831081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8c92b243-a4cd-499f-b0a2-90d8fbbdf718 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28469 microversion: 2.20 time: 0.102356 Aug 19 09:25:39.831767 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 566/1107] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:39 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28469 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:40.843135 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-94d282e4-ad4c-4ab9-9a79-c44168bb28d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:40.844790 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-94d282e4-ad4c-4ab9-9a79-c44168bb28d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:40.851388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-94d282e4-ad4c-4ab9-9a79-c44168bb28d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:40.851827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-94d282e4-ad4c-4ab9-9a79-c44168bb28d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:40.852574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-94d282e4-ad4c-4ab9-9a79-c44168bb28d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:40.852999 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-94d282e4-ad4c-4ab9-9a79-c44168bb28d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:40.943051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-94d282e4-ad4c-4ab9-9a79-c44168bb28d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.103895 Aug 19 09:25:40.943975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 542/1108] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:40 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:41.955603 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-881efa14-5d33-4ed4-a591-a52f60afd689 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:41.956619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-881efa14-5d33-4ed4-a591-a52f60afd689 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:41.962956 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-881efa14-5d33-4ed4-a591-a52f60afd689 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:41.963430 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-881efa14-5d33-4ed4-a591-a52f60afd689 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:41.964185 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-881efa14-5d33-4ed4-a591-a52f60afd689 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:41.964610 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-881efa14-5d33-4ed4-a591-a52f60afd689 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:42.052448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-881efa14-5d33-4ed4-a591-a52f60afd689 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.101350 Aug 19 09:25:42.053095 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 567/1109] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:41 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:25:43.065033 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-19a9cfd7-8582-4bd8-9fd7-6546ba6cdc5d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:43.066029 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-19a9cfd7-8582-4bd8-9fd7-6546ba6cdc5d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:43.072535 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19a9cfd7-8582-4bd8-9fd7-6546ba6cdc5d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:43.073205 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19a9cfd7-8582-4bd8-9fd7-6546ba6cdc5d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:43.073906 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19a9cfd7-8582-4bd8-9fd7-6546ba6cdc5d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:43.074377 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19a9cfd7-8582-4bd8-9fd7-6546ba6cdc5d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:43.153995 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-19a9cfd7-8582-4bd8-9fd7-6546ba6cdc5d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.093507 Aug 19 09:25:43.154597 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 543/1110] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:43 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:44.166907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-39278a6d-f468-48d9-858e-7fcd5a41a32a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:44.167916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-39278a6d-f468-48d9-858e-7fcd5a41a32a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:44.174303 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-39278a6d-f468-48d9-858e-7fcd5a41a32a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:44.174741 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-39278a6d-f468-48d9-858e-7fcd5a41a32a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:44.175523 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-39278a6d-f468-48d9-858e-7fcd5a41a32a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:44.175954 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-39278a6d-f468-48d9-858e-7fcd5a41a32a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:44.257036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-39278a6d-f468-48d9-858e-7fcd5a41a32a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.094033 Aug 19 09:25:44.257673 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 568/1111] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:44 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:45.269587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0b8e9982-2c39-4e28-a657-7ce3b963231f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:45.270524 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0b8e9982-2c39-4e28-a657-7ce3b963231f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:45.276861 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b8e9982-2c39-4e28-a657-7ce3b963231f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:45.277297 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b8e9982-2c39-4e28-a657-7ce3b963231f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:45.278055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b8e9982-2c39-4e28-a657-7ce3b963231f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:45.278481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0b8e9982-2c39-4e28-a657-7ce3b963231f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:45.363402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0b8e9982-2c39-4e28-a657-7ce3b963231f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.098181 Aug 19 09:25:45.364053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 544/1112] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:45 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:45.869133 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:25:45.869667 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: Thu Aug 19 09:25:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:25:46.374751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-bd2492f8-634f-40e7-97fa-5a623a45e7c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:46.376520 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-bd2492f8-634f-40e7-97fa-5a623a45e7c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:46.382961 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd2492f8-634f-40e7-97fa-5a623a45e7c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:46.383443 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd2492f8-634f-40e7-97fa-5a623a45e7c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:46.384205 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd2492f8-634f-40e7-97fa-5a623a45e7c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:46.384633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd2492f8-634f-40e7-97fa-5a623a45e7c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:46.464770 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-bd2492f8-634f-40e7-97fa-5a623a45e7c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.093921 Aug 19 09:25:46.465370 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 569/1113] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:46 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:47.477423 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7f1bb044-8a17-4549-8b6c-0351156a9913 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:47.478407 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7f1bb044-8a17-4549-8b6c-0351156a9913 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:47.484799 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f1bb044-8a17-4549-8b6c-0351156a9913 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:47.485232 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f1bb044-8a17-4549-8b6c-0351156a9913 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:47.485983 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f1bb044-8a17-4549-8b6c-0351156a9913 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:47.486409 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f1bb044-8a17-4549-8b6c-0351156a9913 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:47.567727 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7f1bb044-8a17-4549-8b6c-0351156a9913 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.094541 Aug 19 09:25:47.568372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 545/1114] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:47 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:48.580155 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7be1e180-d691-45b3-88a3-046973cb1602 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:48.581134 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7be1e180-d691-45b3-88a3-046973cb1602 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:48.587625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7be1e180-d691-45b3-88a3-046973cb1602 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:48.588068 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7be1e180-d691-45b3-88a3-046973cb1602 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:48.588822 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7be1e180-d691-45b3-88a3-046973cb1602 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:48.589252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7be1e180-d691-45b3-88a3-046973cb1602 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:48.672377 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7be1e180-d691-45b3-88a3-046973cb1602 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.096283 Aug 19 09:25:48.674301 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 570/1115] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:48 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:49.684133 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e016f5ec-c823-442c-a634-5acfb53322c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:49.685056 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e016f5ec-c823-442c-a634-5acfb53322c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:49.692177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e016f5ec-c823-442c-a634-5acfb53322c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:49.692620 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e016f5ec-c823-442c-a634-5acfb53322c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:49.693367 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e016f5ec-c823-442c-a634-5acfb53322c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:49.693790 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e016f5ec-c823-442c-a634-5acfb53322c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:49.778979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e016f5ec-c823-442c-a634-5acfb53322c5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.098820 Aug 19 09:25:49.779643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 546/1116] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:49 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:50.790996 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c333c0c6-2378-4062-819e-a3872af28302 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:50.791929 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c333c0c6-2378-4062-819e-a3872af28302 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:50.798414 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c333c0c6-2378-4062-819e-a3872af28302 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:50.798855 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c333c0c6-2378-4062-819e-a3872af28302 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:50.799652 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c333c0c6-2378-4062-819e-a3872af28302 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:50.800089 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c333c0c6-2378-4062-819e-a3872af28302 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:50.882238 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c333c0c6-2378-4062-819e-a3872af28302 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.095283 Aug 19 09:25:50.883223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 571/1117] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:50 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:25:51.894680 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1e56943b-283a-4928-be31-bb30cd249d67 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:51.895715 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1e56943b-283a-4928-be31-bb30cd249d67 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:51.902038 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e56943b-283a-4928-be31-bb30cd249d67 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:51.902481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e56943b-283a-4928-be31-bb30cd249d67 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:51.903230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e56943b-283a-4928-be31-bb30cd249d67 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:51.903688 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e56943b-283a-4928-be31-bb30cd249d67 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:51.983948 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1e56943b-283a-4928-be31-bb30cd249d67 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.093678 Aug 19 09:25:51.984557 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 547/1118] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:51 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:52.996158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5da5b95b-912d-4fa5-aa43-58e41c165b8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:52.997191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5da5b95b-912d-4fa5-aa43-58e41c165b8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:53.003658 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5da5b95b-912d-4fa5-aa43-58e41c165b8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:53.004112 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5da5b95b-912d-4fa5-aa43-58e41c165b8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:53.004874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5da5b95b-912d-4fa5-aa43-58e41c165b8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:53.005315 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5da5b95b-912d-4fa5-aa43-58e41c165b8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:53.083728 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5da5b95b-912d-4fa5-aa43-58e41c165b8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.091502 Aug 19 09:25:53.084349 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 572/1119] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:52 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:54.095738 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ce006b42-df9c-4d50-9bf1-72dc95819204 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:54.096758 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ce006b42-df9c-4d50-9bf1-72dc95819204 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:54.103154 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ce006b42-df9c-4d50-9bf1-72dc95819204 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:54.103624 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ce006b42-df9c-4d50-9bf1-72dc95819204 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:54.104388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ce006b42-df9c-4d50-9bf1-72dc95819204 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:54.104827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ce006b42-df9c-4d50-9bf1-72dc95819204 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:54.183548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ce006b42-df9c-4d50-9bf1-72dc95819204 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.092150 Aug 19 09:25:54.184214 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 548/1120] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:54 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:55.195599 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-dc968f33-3a9e-4d7d-a7d2-42d94a4db08c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:55.196608 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-dc968f33-3a9e-4d7d-a7d2-42d94a4db08c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:55.202944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dc968f33-3a9e-4d7d-a7d2-42d94a4db08c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:55.203418 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dc968f33-3a9e-4d7d-a7d2-42d94a4db08c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:55.204296 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dc968f33-3a9e-4d7d-a7d2-42d94a4db08c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:55.204728 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dc968f33-3a9e-4d7d-a7d2-42d94a4db08c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:55.286937 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-dc968f33-3a9e-4d7d-a7d2-42d94a4db08c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.095304 Aug 19 09:25:55.287614 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 573/1121] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:55 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:56.298934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1535b5ca-da11-44b5-835a-395ebe5ed32b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:56.299942 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1535b5ca-da11-44b5-835a-395ebe5ed32b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:56.306256 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1535b5ca-da11-44b5-835a-395ebe5ed32b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:56.306695 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1535b5ca-da11-44b5-835a-395ebe5ed32b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:56.307545 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1535b5ca-da11-44b5-835a-395ebe5ed32b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:56.307979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1535b5ca-da11-44b5-835a-395ebe5ed32b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:56.394199 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1535b5ca-da11-44b5-835a-395ebe5ed32b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.099879 Aug 19 09:25:56.394835 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 549/1122] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:56 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:25:57.410080 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-47c165ff-0589-4e83-bd95-9a43c2d3b6f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:57.411916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-47c165ff-0589-4e83-bd95-9a43c2d3b6f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:57.418387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-47c165ff-0589-4e83-bd95-9a43c2d3b6f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:57.418831 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-47c165ff-0589-4e83-bd95-9a43c2d3b6f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:57.419640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-47c165ff-0589-4e83-bd95-9a43c2d3b6f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:57.420106 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-47c165ff-0589-4e83-bd95-9a43c2d3b6f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:57.506938 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-47c165ff-0589-4e83-bd95-9a43c2d3b6f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.104569 Aug 19 09:25:57.507642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 574/1123] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:57 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:58.518577 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7faf4fd6-68c4-4324-bed1-331df99c6a79 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:58.519605 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7faf4fd6-68c4-4324-bed1-331df99c6a79 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:58.525894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7faf4fd6-68c4-4324-bed1-331df99c6a79 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:58.526337 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7faf4fd6-68c4-4324-bed1-331df99c6a79 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:58.527101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7faf4fd6-68c4-4324-bed1-331df99c6a79 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:58.527561 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7faf4fd6-68c4-4324-bed1-331df99c6a79 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:58.562054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-18d6cf93-4858-4d4a-a78f-2dabb5bc5117 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:25:58.562628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-18d6cf93-4858-4d4a-a78f-2dabb5bc5117 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:58.569848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18d6cf93-4858-4d4a-a78f-2dabb5bc5117 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:58.570292 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18d6cf93-4858-4d4a-a78f-2dabb5bc5117 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:58.571046 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18d6cf93-4858-4d4a-a78f-2dabb5bc5117 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:58.571506 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-18d6cf93-4858-4d4a-a78f-2dabb5bc5117 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:58.618125 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7faf4fd6-68c4-4324-bed1-331df99c6a79 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.103531 Aug 19 09:25:58.618796 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 550/1124] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:58 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:58.654466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-18d6cf93-4858-4d4a-a78f-2dabb5bc5117 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lazy-loading 'services' on Instance uuid 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:25:58.720679 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-18d6cf93-4858-4d4a-a78f-2dabb5bc5117 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/os-volume_attachments/bff0d387-2e87-4eb7-98eb-d037dca9da7f" status: 202 len: 0 microversion: 2.1 time: 0.162533 Aug 19 09:25:58.721287 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 575/1125] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:25:58 2021] DELETE /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/os-volume_attachments/bff0d387-2e87-4eb7-98eb-d037dca9da7f => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:25:59.631112 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4dd06e52-6950-4984-af88-71a7f9e83f3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:59.632067 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4dd06e52-6950-4984-af88-71a7f9e83f3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:59.638648 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4dd06e52-6950-4984-af88-71a7f9e83f3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:59.639108 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4dd06e52-6950-4984-af88-71a7f9e83f3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:59.639905 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4dd06e52-6950-4984-af88-71a7f9e83f3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:59.640335 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4dd06e52-6950-4984-af88-71a7f9e83f3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:59.740163 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4dd06e52-6950-4984-af88-71a7f9e83f3b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.112937 Aug 19 09:25:59.740862 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 551/1126] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:25:59 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:59.840725 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a787fda9-97f9-4246-b6f3-88210276502d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:25:59.847330 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a787fda9-97f9-4246-b6f3-88210276502d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:59.847773 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a787fda9-97f9-4246-b6f3-88210276502d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:59.869359 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a787fda9-97f9-4246-b6f3-88210276502d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Going to try to stop instance {{(pid=107957) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 19 09:25:59.907607 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a787fda9-97f9-4246-b6f3-88210276502d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 202 len: 0 microversion: 2.1 time: 0.070616 Aug 19 09:25:59.908108 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 576/1127] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:25:59 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:25:59.916541 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e3bd4b41-e615-4fa1-98cf-8c6d58b70d20 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:25:59.917237 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e3bd4b41-e615-4fa1-98cf-8c6d58b70d20 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:25:59.924911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e3bd4b41-e615-4fa1-98cf-8c6d58b70d20 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:59.925354 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e3bd4b41-e615-4fa1-98cf-8c6d58b70d20 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:25:59.926126 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e3bd4b41-e615-4fa1-98cf-8c6d58b70d20 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:25:59.926557 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e3bd4b41-e615-4fa1-98cf-8c6d58b70d20 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:00.050282 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e3bd4b41-e615-4fa1-98cf-8c6d58b70d20 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:00.057475 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e3bd4b41-e615-4fa1-98cf-8c6d58b70d20 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1678 microversion: 2.1 time: 0.144920 Aug 19 09:26:00.058041 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 552/1128] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:25:59 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:26:00.753356 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1243ac67-3d2d-4f70-bdbb-17ae6dc407f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:00.754272 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1243ac67-3d2d-4f70-bdbb-17ae6dc407f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:00.760533 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1243ac67-3d2d-4f70-bdbb-17ae6dc407f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:00.760988 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1243ac67-3d2d-4f70-bdbb-17ae6dc407f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:00.761757 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1243ac67-3d2d-4f70-bdbb-17ae6dc407f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:00.762224 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1243ac67-3d2d-4f70-bdbb-17ae6dc407f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:00.861761 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1243ac67-3d2d-4f70-bdbb-17ae6dc407f3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.113273 Aug 19 09:26:00.862385 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 577/1129] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:00 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:01.074741 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-841b3994-74d7-443b-b35d-0b1929dd5af5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:01.075392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-841b3994-74d7-443b-b35d-0b1929dd5af5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:01.082156 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-841b3994-74d7-443b-b35d-0b1929dd5af5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:01.082600 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-841b3994-74d7-443b-b35d-0b1929dd5af5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:01.083385 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-841b3994-74d7-443b-b35d-0b1929dd5af5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:01.083819 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-841b3994-74d7-443b-b35d-0b1929dd5af5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:01.201168 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-841b3994-74d7-443b-b35d-0b1929dd5af5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:01.208551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-841b3994-74d7-443b-b35d-0b1929dd5af5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1678 microversion: 2.1 time: 0.137991 Aug 19 09:26:01.209105 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 553/1130] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:01 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1678 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:01.873995 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1393d5f3-5166-43c0-a08c-16d79ddf49d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:01.875016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1393d5f3-5166-43c0-a08c-16d79ddf49d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:01.881979 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1393d5f3-5166-43c0-a08c-16d79ddf49d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:01.882426 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1393d5f3-5166-43c0-a08c-16d79ddf49d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:01.883183 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1393d5f3-5166-43c0-a08c-16d79ddf49d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:01.883647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1393d5f3-5166-43c0-a08c-16d79ddf49d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:01.972923 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1393d5f3-5166-43c0-a08c-16d79ddf49d1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.102836 Aug 19 09:26:01.973798 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 578/1131] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:01 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:02.225262 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cf851864-191a-436d-b98c-d88679c440c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:02.225813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-cf851864-191a-436d-b98c-d88679c440c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:02.231641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cf851864-191a-436d-b98c-d88679c440c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:02.232094 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cf851864-191a-436d-b98c-d88679c440c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:02.232857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cf851864-191a-436d-b98c-d88679c440c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:02.233294 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cf851864-191a-436d-b98c-d88679c440c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:02.353203 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-cf851864-191a-436d-b98c-d88679c440c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:02.360965 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-cf851864-191a-436d-b98c-d88679c440c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1678 microversion: 2.1 time: 0.139659 Aug 19 09:26:02.361517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 554/1132] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:02 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1678 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:02.984209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e3ed2cf4-e0c9-4aa3-8f59-5d1b5ca89085 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:02.985710 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e3ed2cf4-e0c9-4aa3-8f59-5d1b5ca89085 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:02.992187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e3ed2cf4-e0c9-4aa3-8f59-5d1b5ca89085 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:02.992629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e3ed2cf4-e0c9-4aa3-8f59-5d1b5ca89085 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:02.993389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e3ed2cf4-e0c9-4aa3-8f59-5d1b5ca89085 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:02.993820 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e3ed2cf4-e0c9-4aa3-8f59-5d1b5ca89085 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:03.080522 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e3ed2cf4-e0c9-4aa3-8f59-5d1b5ca89085 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.100134 Aug 19 09:26:03.081385 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 579/1133] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:02 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:03.377987 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bdca4b23-542f-4036-99b1-07dfa6dc1e1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:03.378623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bdca4b23-542f-4036-99b1-07dfa6dc1e1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:03.384822 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bdca4b23-542f-4036-99b1-07dfa6dc1e1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:03.385264 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bdca4b23-542f-4036-99b1-07dfa6dc1e1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:03.386016 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bdca4b23-542f-4036-99b1-07dfa6dc1e1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:03.386445 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bdca4b23-542f-4036-99b1-07dfa6dc1e1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:03.507393 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bdca4b23-542f-4036-99b1-07dfa6dc1e1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:03.514557 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bdca4b23-542f-4036-99b1-07dfa6dc1e1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1678 microversion: 2.1 time: 0.140703 Aug 19 09:26:03.515121 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 555/1134] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:03 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1678 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:04.092828 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6bdab4d7-7c17-40ec-9c48-98253bdc3255 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:04.093801 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6bdab4d7-7c17-40ec-9c48-98253bdc3255 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:04.102187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6bdab4d7-7c17-40ec-9c48-98253bdc3255 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:04.102629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6bdab4d7-7c17-40ec-9c48-98253bdc3255 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:04.103426 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6bdab4d7-7c17-40ec-9c48-98253bdc3255 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:04.103863 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6bdab4d7-7c17-40ec-9c48-98253bdc3255 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:04.195919 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6bdab4d7-7c17-40ec-9c48-98253bdc3255 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.106908 Aug 19 09:26:04.196571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 580/1135] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:04 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:26:04.531252 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f426b12a-99cd-49ef-ab9b-e92d6af0dbd5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:04.532473 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f426b12a-99cd-49ef-ab9b-e92d6af0dbd5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:04.538267 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f426b12a-99cd-49ef-ab9b-e92d6af0dbd5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:04.538708 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f426b12a-99cd-49ef-ab9b-e92d6af0dbd5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:04.539495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f426b12a-99cd-49ef-ab9b-e92d6af0dbd5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:04.539931 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f426b12a-99cd-49ef-ab9b-e92d6af0dbd5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:04.658210 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f426b12a-99cd-49ef-ab9b-e92d6af0dbd5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:04.665320 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f426b12a-99cd-49ef-ab9b-e92d6af0dbd5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1678 microversion: 2.1 time: 0.137735 Aug 19 09:26:04.665912 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 556/1136] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:04 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1678 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:05.209464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d749e621-2571-4fb1-a07d-9fcd0b51a12e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:05.210444 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d749e621-2571-4fb1-a07d-9fcd0b51a12e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:05.216798 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d749e621-2571-4fb1-a07d-9fcd0b51a12e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:05.217238 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d749e621-2571-4fb1-a07d-9fcd0b51a12e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:05.217987 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d749e621-2571-4fb1-a07d-9fcd0b51a12e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:05.218412 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d749e621-2571-4fb1-a07d-9fcd0b51a12e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:05.301605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d749e621-2571-4fb1-a07d-9fcd0b51a12e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.096119 Aug 19 09:26:05.302214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 581/1137] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:05 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:26:05.681701 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e293295f-b520-400e-a2ea-f20b250c0e6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:05.682447 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e293295f-b520-400e-a2ea-f20b250c0e6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:05.688203 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e293295f-b520-400e-a2ea-f20b250c0e6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:05.688640 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e293295f-b520-400e-a2ea-f20b250c0e6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:05.689391 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e293295f-b520-400e-a2ea-f20b250c0e6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:05.689817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e293295f-b520-400e-a2ea-f20b250c0e6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:05.810737 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e293295f-b520-400e-a2ea-f20b250c0e6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:05.817971 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e293295f-b520-400e-a2ea-f20b250c0e6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1678 microversion: 2.1 time: 0.139937 Aug 19 09:26:05.818531 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 557/1138] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:05 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1678 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:06.314174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-925eb5e9-354d-4f34-a7fc-eed0214f2963 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:06.315162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-925eb5e9-354d-4f34-a7fc-eed0214f2963 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:06.321573 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-925eb5e9-354d-4f34-a7fc-eed0214f2963 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:06.322015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-925eb5e9-354d-4f34-a7fc-eed0214f2963 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:06.322772 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-925eb5e9-354d-4f34-a7fc-eed0214f2963 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:06.323203 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-925eb5e9-354d-4f34-a7fc-eed0214f2963 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:06.410058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-925eb5e9-354d-4f34-a7fc-eed0214f2963 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.100326 Aug 19 09:26:06.410683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 582/1139] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:06 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:26:06.834607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-dbeae71d-3f51-4b86-897e-0a4d5f1b12f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:06.835201 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-dbeae71d-3f51-4b86-897e-0a4d5f1b12f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:06.840959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dbeae71d-3f51-4b86-897e-0a4d5f1b12f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:06.841398 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dbeae71d-3f51-4b86-897e-0a4d5f1b12f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:06.842146 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dbeae71d-3f51-4b86-897e-0a4d5f1b12f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:06.842574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dbeae71d-3f51-4b86-897e-0a4d5f1b12f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:06.962733 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dbeae71d-3f51-4b86-897e-0a4d5f1b12f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:06.970077 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-dbeae71d-3f51-4b86-897e-0a4d5f1b12f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1678 microversion: 2.1 time: 0.139113 Aug 19 09:26:06.970627 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 558/1140] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:06 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1678 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:07.422820 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-262c4380-0997-4fe0-a6a0-81e6ca623594 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:07.423825 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-262c4380-0997-4fe0-a6a0-81e6ca623594 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:07.430485 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-262c4380-0997-4fe0-a6a0-81e6ca623594 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:07.430934 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-262c4380-0997-4fe0-a6a0-81e6ca623594 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:07.431717 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-262c4380-0997-4fe0-a6a0-81e6ca623594 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:07.432181 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-262c4380-0997-4fe0-a6a0-81e6ca623594 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:07.518894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-262c4380-0997-4fe0-a6a0-81e6ca623594 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.100741 Aug 19 09:26:07.519566 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 583/1141] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:07 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:07.987710 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-dc81c9d2-2e69-4586-bf74-a840fe67d8f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:07.988332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-dc81c9d2-2e69-4586-bf74-a840fe67d8f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:07.994430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dc81c9d2-2e69-4586-bf74-a840fe67d8f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:07.994868 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dc81c9d2-2e69-4586-bf74-a840fe67d8f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:07.995649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dc81c9d2-2e69-4586-bf74-a840fe67d8f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:07.996078 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dc81c9d2-2e69-4586-bf74-a840fe67d8f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:08.115042 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-dc81c9d2-2e69-4586-bf74-a840fe67d8f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:08.122279 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-dc81c9d2-2e69-4586-bf74-a840fe67d8f5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1678 microversion: 2.1 time: 0.139011 Aug 19 09:26:08.122835 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 559/1142] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:07 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1678 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:08.530790 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-78fae4bf-859f-4f8b-950a-d7d2089417ac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:08.532397 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-78fae4bf-859f-4f8b-950a-d7d2089417ac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:08.538688 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-78fae4bf-859f-4f8b-950a-d7d2089417ac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:08.539125 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-78fae4bf-859f-4f8b-950a-d7d2089417ac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:08.539907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-78fae4bf-859f-4f8b-950a-d7d2089417ac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:08.540337 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-78fae4bf-859f-4f8b-950a-d7d2089417ac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:08.622589 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-78fae4bf-859f-4f8b-950a-d7d2089417ac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.095733 Aug 19 09:26:08.623188 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 584/1143] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:08 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:09.139115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e81e49d1-325a-4bd7-88f0-e7ef818f6900 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:09.139755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e81e49d1-325a-4bd7-88f0-e7ef818f6900 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:09.145642 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e81e49d1-325a-4bd7-88f0-e7ef818f6900 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:09.146087 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e81e49d1-325a-4bd7-88f0-e7ef818f6900 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:09.146844 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e81e49d1-325a-4bd7-88f0-e7ef818f6900 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:09.147295 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e81e49d1-325a-4bd7-88f0-e7ef818f6900 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:09.263380 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e81e49d1-325a-4bd7-88f0-e7ef818f6900 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:09.270648 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e81e49d1-325a-4bd7-88f0-e7ef818f6900 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1678 microversion: 2.1 time: 0.135169 Aug 19 09:26:09.271196 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 560/1144] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:09 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1678 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:09.635180 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a6261a1d-04b2-4d6a-b020-073a18b84ca9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:09.636192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a6261a1d-04b2-4d6a-b020-073a18b84ca9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:09.642519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a6261a1d-04b2-4d6a-b020-073a18b84ca9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:09.642958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a6261a1d-04b2-4d6a-b020-073a18b84ca9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:09.643743 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a6261a1d-04b2-4d6a-b020-073a18b84ca9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:09.644175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a6261a1d-04b2-4d6a-b020-073a18b84ca9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:09.735310 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a6261a1d-04b2-4d6a-b020-073a18b84ca9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 28637 microversion: 2.20 time: 0.103900 Aug 19 09:26:09.735870 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 585/1145] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:09 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 28637 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:10.287163 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-48369940-5575-422f-80ea-2ee7e5d33970 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:10.287803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-48369940-5575-422f-80ea-2ee7e5d33970 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:10.294562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-48369940-5575-422f-80ea-2ee7e5d33970 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:10.295197 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-48369940-5575-422f-80ea-2ee7e5d33970 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:10.296005 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-48369940-5575-422f-80ea-2ee7e5d33970 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:10.296429 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-48369940-5575-422f-80ea-2ee7e5d33970 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:10.421635 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-48369940-5575-422f-80ea-2ee7e5d33970 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:10.429581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-48369940-5575-422f-80ea-2ee7e5d33970 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1655 microversion: 2.1 time: 0.146158 Aug 19 09:26:10.430130 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 561/1146] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:10 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:10.445952 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b0208ace-c458-4f63-893c-03b917009cdc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:10.452342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b0208ace-c458-4f63-893c-03b917009cdc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:10.452790 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b0208ace-c458-4f63-893c-03b917009cdc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:10.476009 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b0208ace-c458-4f63-893c-03b917009cdc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Going to try to start instance {{(pid=107957) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 19 09:26:10.514151 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b0208ace-c458-4f63-893c-03b917009cdc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action" status: 202 len: 0 microversion: 2.1 time: 0.072022 Aug 19 09:26:10.514736 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 586/1147] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:26:10 2021] POST /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:10.523230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-37d862ff-eb7b-461d-b817-314477eb4eab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:10.523868 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-37d862ff-eb7b-461d-b817-314477eb4eab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:10.529774 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-37d862ff-eb7b-461d-b817-314477eb4eab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:10.530218 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-37d862ff-eb7b-461d-b817-314477eb4eab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:10.530975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-37d862ff-eb7b-461d-b817-314477eb4eab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:10.532094 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-37d862ff-eb7b-461d-b817-314477eb4eab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:10.676744 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-37d862ff-eb7b-461d-b817-314477eb4eab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:10.683913 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-37d862ff-eb7b-461d-b817-314477eb4eab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1664 microversion: 2.1 time: 0.164377 Aug 19 09:26:10.684479 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 562/1148] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:10 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:10.746374 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5c92b884-498b-49db-8b8d-d7acf0db8392 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:10.747384 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5c92b884-498b-49db-8b8d-d7acf0db8392 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:10.754104 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c92b884-498b-49db-8b8d-d7acf0db8392 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:10.754546 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c92b884-498b-49db-8b8d-d7acf0db8392 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:10.755360 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c92b884-498b-49db-8b8d-d7acf0db8392 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:10.755762 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c92b884-498b-49db-8b8d-d7acf0db8392 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:10.853085 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5c92b884-498b-49db-8b8d-d7acf0db8392 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 29204 microversion: 2.20 time: 0.110619 Aug 19 09:26:10.854018 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 587/1149] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:10 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 29204 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:11.700655 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4473e9e9-7017-42cc-809e-244ec8878b13 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:11.701191 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4473e9e9-7017-42cc-809e-244ec8878b13 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:11.707909 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4473e9e9-7017-42cc-809e-244ec8878b13 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:11.708346 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4473e9e9-7017-42cc-809e-244ec8878b13 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:11.709100 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4473e9e9-7017-42cc-809e-244ec8878b13 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:11.709522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4473e9e9-7017-42cc-809e-244ec8878b13 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:11.845110 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4473e9e9-7017-42cc-809e-244ec8878b13 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:11.852524 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4473e9e9-7017-42cc-809e-244ec8878b13 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1664 microversion: 2.1 time: 0.155582 Aug 19 09:26:11.853079 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 563/1150] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:11 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:11.864998 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-933d0d68-ea76-47d3-9d2b-f59008f0f5b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:11.865988 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-933d0d68-ea76-47d3-9d2b-f59008f0f5b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:11.872511 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-933d0d68-ea76-47d3-9d2b-f59008f0f5b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:11.872964 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-933d0d68-ea76-47d3-9d2b-f59008f0f5b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:11.873723 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-933d0d68-ea76-47d3-9d2b-f59008f0f5b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:11.874150 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-933d0d68-ea76-47d3-9d2b-f59008f0f5b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:11.979946 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-933d0d68-ea76-47d3-9d2b-f59008f0f5b5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 31244 microversion: 2.20 time: 0.118665 Aug 19 09:26:11.980500 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 588/1151] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:11 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 31244 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:12.869244 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f72cf4b4-4eb8-43ee-b0f5-d8f52bd4a3bf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:12.869902 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f72cf4b4-4eb8-43ee-b0f5-d8f52bd4a3bf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:12.875765 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f72cf4b4-4eb8-43ee-b0f5-d8f52bd4a3bf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:12.876242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f72cf4b4-4eb8-43ee-b0f5-d8f52bd4a3bf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:12.876980 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f72cf4b4-4eb8-43ee-b0f5-d8f52bd4a3bf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:12.877413 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f72cf4b4-4eb8-43ee-b0f5-d8f52bd4a3bf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:12.991939 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-120ca02b-0858-4460-823f-2cfdf550d08d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:12.993020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-120ca02b-0858-4460-823f-2cfdf550d08d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:12.999347 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-120ca02b-0858-4460-823f-2cfdf550d08d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:12.999657 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f72cf4b4-4eb8-43ee-b0f5-d8f52bd4a3bf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:12.999804 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-120ca02b-0858-4460-823f-2cfdf550d08d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:13.000748 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-120ca02b-0858-4460-823f-2cfdf550d08d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:13.001174 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-120ca02b-0858-4460-823f-2cfdf550d08d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:13.006819 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f72cf4b4-4eb8-43ee-b0f5-d8f52bd4a3bf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1668 microversion: 2.1 time: 0.141315 Aug 19 09:26:13.007389 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 564/1152] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:26:12 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1668 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:26:13.097539 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-120ca02b-0858-4460-823f-2cfdf550d08d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 32810 microversion: 2.20 time: 0.109427 Aug 19 09:26:13.098164 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 589/1153] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:12 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 32810 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:26:14.110145 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-65a54245-ae82-4d83-ba8e-489d05bd67e3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:14.111109 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-65a54245-ae82-4d83-ba8e-489d05bd67e3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:14.116859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65a54245-ae82-4d83-ba8e-489d05bd67e3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:14.117302 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65a54245-ae82-4d83-ba8e-489d05bd67e3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:14.118057 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65a54245-ae82-4d83-ba8e-489d05bd67e3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:14.118482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-65a54245-ae82-4d83-ba8e-489d05bd67e3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:14.210074 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-65a54245-ae82-4d83-ba8e-489d05bd67e3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 33890 microversion: 2.20 time: 0.104219 Aug 19 09:26:14.210716 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 565/1154] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:14 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 33890 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:15.223091 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3d58e999-826b-49cb-8a55-681f8aa2a220 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:15.224366 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3d58e999-826b-49cb-8a55-681f8aa2a220 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:15.230372 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d58e999-826b-49cb-8a55-681f8aa2a220 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:15.230814 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d58e999-826b-49cb-8a55-681f8aa2a220 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:15.231606 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d58e999-826b-49cb-8a55-681f8aa2a220 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:15.232025 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3d58e999-826b-49cb-8a55-681f8aa2a220 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:15.317935 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3d58e999-826b-49cb-8a55-681f8aa2a220 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 35296 microversion: 2.20 time: 0.099335 Aug 19 09:26:15.319044 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 590/1155] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:15 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 35296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:16.330428 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-39d0bbe3-d5a1-4d04-91aa-859a5737093d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:16.331453 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-39d0bbe3-d5a1-4d04-91aa-859a5737093d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:16.337984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-39d0bbe3-d5a1-4d04-91aa-859a5737093d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:16.338433 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-39d0bbe3-d5a1-4d04-91aa-859a5737093d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:16.339204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-39d0bbe3-d5a1-4d04-91aa-859a5737093d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:16.339669 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-39d0bbe3-d5a1-4d04-91aa-859a5737093d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:16.431071 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-39d0bbe3-d5a1-4d04-91aa-859a5737093d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 36957 microversion: 2.20 time: 0.105162 Aug 19 09:26:16.432051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 566/1156] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:16 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 36957 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:17.443938 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0d1e94d9-ae1a-4452-a335-485ccd466bd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:17.444958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0d1e94d9-ae1a-4452-a335-485ccd466bd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:17.451298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d1e94d9-ae1a-4452-a335-485ccd466bd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:17.451752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d1e94d9-ae1a-4452-a335-485ccd466bd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:17.452513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d1e94d9-ae1a-4452-a335-485ccd466bd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:17.453062 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d1e94d9-ae1a-4452-a335-485ccd466bd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:17.539553 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0d1e94d9-ae1a-4452-a335-485ccd466bd4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 38190 microversion: 2.20 time: 0.099461 Aug 19 09:26:17.540172 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 591/1157] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:17 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 38190 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:18.551674 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3c310e90-7e4d-4255-a1ab-745389ffb9ee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:18.552683 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3c310e90-7e4d-4255-a1ab-745389ffb9ee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:18.558971 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c310e90-7e4d-4255-a1ab-745389ffb9ee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:18.559448 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c310e90-7e4d-4255-a1ab-745389ffb9ee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:18.560198 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c310e90-7e4d-4255-a1ab-745389ffb9ee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:18.560621 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c310e90-7e4d-4255-a1ab-745389ffb9ee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:18.653129 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3c310e90-7e4d-4255-a1ab-745389ffb9ee tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 38190 microversion: 2.20 time: 0.105291 Aug 19 09:26:18.653663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 567/1158] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:18 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 38190 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:19.665518 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-71035b18-8287-4b13-aeb2-e71760a457e5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:19.666444 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-71035b18-8287-4b13-aeb2-e71760a457e5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:19.673393 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-71035b18-8287-4b13-aeb2-e71760a457e5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:19.673843 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-71035b18-8287-4b13-aeb2-e71760a457e5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:19.674618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-71035b18-8287-4b13-aeb2-e71760a457e5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:19.675056 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-71035b18-8287-4b13-aeb2-e71760a457e5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:19.757267 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-71035b18-8287-4b13-aeb2-e71760a457e5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 38190 microversion: 2.20 time: 0.095769 Aug 19 09:26:19.757874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 592/1159] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:19 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 38190 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:20.769735 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a413c9d1-74b3-43b4-8323-8399449f2f0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:20.770649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a413c9d1-74b3-43b4-8323-8399449f2f0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:20.777036 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a413c9d1-74b3-43b4-8323-8399449f2f0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:20.777483 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a413c9d1-74b3-43b4-8323-8399449f2f0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:20.778243 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a413c9d1-74b3-43b4-8323-8399449f2f0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:20.778674 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a413c9d1-74b3-43b4-8323-8399449f2f0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:20.860623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a413c9d1-74b3-43b4-8323-8399449f2f0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 38190 microversion: 2.20 time: 0.095016 Aug 19 09:26:20.861265 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 568/1160] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:20 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 38190 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:26:21.872398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-765bbffe-3d09-4318-bd50-0d06d5783e0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:21.873410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-765bbffe-3d09-4318-bd50-0d06d5783e0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:21.880340 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-765bbffe-3d09-4318-bd50-0d06d5783e0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:21.880783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-765bbffe-3d09-4318-bd50-0d06d5783e0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:21.881538 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-765bbffe-3d09-4318-bd50-0d06d5783e0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:21.881965 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-765bbffe-3d09-4318-bd50-0d06d5783e0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:21.985505 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-765bbffe-3d09-4318-bd50-0d06d5783e0c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 200 len: 38331 microversion: 2.20 time: 0.116861 Aug 19 09:26:21.986132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 593/1161] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:21 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 38331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:26:21.996289 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8312c2b2-31ab-47ad-b7a7-cdd72456d8db tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:21.996877 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8312c2b2-31ab-47ad-b7a7-cdd72456d8db tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:22.004539 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8312c2b2-31ab-47ad-b7a7-cdd72456d8db tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:22.004992 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8312c2b2-31ab-47ad-b7a7-cdd72456d8db tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:22.005757 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8312c2b2-31ab-47ad-b7a7-cdd72456d8db tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:22.006194 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8312c2b2-31ab-47ad-b7a7-cdd72456d8db tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:22.029214 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8312c2b2-31ab-47ad-b7a7-cdd72456d8db tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/ips" status: 200 len: 151 microversion: 2.20 time: 0.036944 Aug 19 09:26:22.029770 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 569/1162] 10.222.0.32 () {60 vars in 1289 bytes} [Thu Aug 19 09:26:21 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:26:24.111223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c1f1f81c-ad8c-4a83-8d0e-f5c50cdbf027 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:24.111865 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c1f1f81c-ad8c-4a83-8d0e-f5c50cdbf027 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:24.118334 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1f1f81c-ad8c-4a83-8d0e-f5c50cdbf027 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:24.118783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1f1f81c-ad8c-4a83-8d0e-f5c50cdbf027 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:24.119630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1f1f81c-ad8c-4a83-8d0e-f5c50cdbf027 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:24.120052 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c1f1f81c-ad8c-4a83-8d0e-f5c50cdbf027 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:24.144140 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-c1f1f81c-ad8c-4a83-8d0e-f5c50cdbf027 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lazy-loading 'flavor' on Instance uuid 89098f09-c8cd-4e15-bef5-1bc104634225 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:26:24.397173 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c1f1f81c-ad8c-4a83-8d0e-f5c50cdbf027 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 202 len: 0 microversion: 2.20 time: 0.290752 Aug 19 09:26:24.397957 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 594/1163] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:26:24 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:26:24.405854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ffc51cf6-e01b-4228-aa70-ba45947b9b95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:24.406546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ffc51cf6-e01b-4228-aa70-ba45947b9b95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:24.412699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ffc51cf6-e01b-4228-aa70-ba45947b9b95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:24.413144 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ffc51cf6-e01b-4228-aa70-ba45947b9b95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:24.413902 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ffc51cf6-e01b-4228-aa70-ba45947b9b95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:24.414346 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ffc51cf6-e01b-4228-aa70-ba45947b9b95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:24.536363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ffc51cf6-e01b-4228-aa70-ba45947b9b95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:24.543971 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ffc51cf6-e01b-4228-aa70-ba45947b9b95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:24.545459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ffc51cf6-e01b-4228-aa70-ba45947b9b95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:24.546638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ffc51cf6-e01b-4228-aa70-ba45947b9b95 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.144416 Aug 19 09:26:24.547182 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 570/1164] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:24 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:26:25.566114 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-996ed456-4db0-447c-9d9a-a58f4ef7746c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:25.566805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-996ed456-4db0-447c-9d9a-a58f4ef7746c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:25.572936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-996ed456-4db0-447c-9d9a-a58f4ef7746c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:25.573381 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-996ed456-4db0-447c-9d9a-a58f4ef7746c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:25.574148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-996ed456-4db0-447c-9d9a-a58f4ef7746c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:25.574612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-996ed456-4db0-447c-9d9a-a58f4ef7746c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:25.693510 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-996ed456-4db0-447c-9d9a-a58f4ef7746c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:25.701028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-996ed456-4db0-447c-9d9a-a58f4ef7746c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:25.703012 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-996ed456-4db0-447c-9d9a-a58f4ef7746c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:25.704416 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-996ed456-4db0-447c-9d9a-a58f4ef7746c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.142833 Aug 19 09:26:25.704958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 595/1165] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:25 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:26.723021 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b223d216-4aad-4e97-86a8-e3b58edbc8f8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:26.723877 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b223d216-4aad-4e97-86a8-e3b58edbc8f8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:26.730093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b223d216-4aad-4e97-86a8-e3b58edbc8f8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:26.730536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b223d216-4aad-4e97-86a8-e3b58edbc8f8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:26.731313 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b223d216-4aad-4e97-86a8-e3b58edbc8f8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:26.731746 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b223d216-4aad-4e97-86a8-e3b58edbc8f8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:26.849361 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b223d216-4aad-4e97-86a8-e3b58edbc8f8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:26.856960 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b223d216-4aad-4e97-86a8-e3b58edbc8f8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:26.858463 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b223d216-4aad-4e97-86a8-e3b58edbc8f8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:26.860699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b223d216-4aad-4e97-86a8-e3b58edbc8f8 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.141541 Aug 19 09:26:26.861253 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 571/1166] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:26 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:27.878395 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9750fa65-e488-4bbe-bd5e-5567662c67a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:27.879000 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9750fa65-e488-4bbe-bd5e-5567662c67a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:27.885192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9750fa65-e488-4bbe-bd5e-5567662c67a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:27.885641 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9750fa65-e488-4bbe-bd5e-5567662c67a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:27.886399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9750fa65-e488-4bbe-bd5e-5567662c67a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:27.886824 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9750fa65-e488-4bbe-bd5e-5567662c67a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:28.010646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9750fa65-e488-4bbe-bd5e-5567662c67a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:28.018274 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9750fa65-e488-4bbe-bd5e-5567662c67a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:28.019800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9750fa65-e488-4bbe-bd5e-5567662c67a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:28.020916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9750fa65-e488-4bbe-bd5e-5567662c67a5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.146912 Aug 19 09:26:28.021463 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 596/1167] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:27 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:29.040040 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-af36929e-1fea-4d7e-9a1b-e0c18e877479 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:29.040653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-af36929e-1fea-4d7e-9a1b-e0c18e877479 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:29.047397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af36929e-1fea-4d7e-9a1b-e0c18e877479 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:29.047849 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af36929e-1fea-4d7e-9a1b-e0c18e877479 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:29.048624 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af36929e-1fea-4d7e-9a1b-e0c18e877479 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:29.049254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af36929e-1fea-4d7e-9a1b-e0c18e877479 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:29.169578 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-af36929e-1fea-4d7e-9a1b-e0c18e877479 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:29.177870 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-af36929e-1fea-4d7e-9a1b-e0c18e877479 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:29.179367 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-af36929e-1fea-4d7e-9a1b-e0c18e877479 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:29.180493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-af36929e-1fea-4d7e-9a1b-e0c18e877479 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.144175 Aug 19 09:26:29.181042 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 572/1168] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:29 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:30.198226 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8f4ca4e5-990f-4c11-89bb-b3bd1d14d02e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:30.198934 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8f4ca4e5-990f-4c11-89bb-b3bd1d14d02e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:30.204639 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f4ca4e5-990f-4c11-89bb-b3bd1d14d02e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:30.205079 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f4ca4e5-990f-4c11-89bb-b3bd1d14d02e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:30.205827 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f4ca4e5-990f-4c11-89bb-b3bd1d14d02e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:30.206252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f4ca4e5-990f-4c11-89bb-b3bd1d14d02e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:30.321564 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8f4ca4e5-990f-4c11-89bb-b3bd1d14d02e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:30.329133 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8f4ca4e5-990f-4c11-89bb-b3bd1d14d02e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:30.330608 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8f4ca4e5-990f-4c11-89bb-b3bd1d14d02e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:30.331767 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8f4ca4e5-990f-4c11-89bb-b3bd1d14d02e tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.137182 Aug 19 09:26:30.332312 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 597/1169] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:30 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:31.350232 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-302bd0a6-3ebf-4822-9f21-6387be0e7e04 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:31.350760 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-302bd0a6-3ebf-4822-9f21-6387be0e7e04 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:31.356963 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-302bd0a6-3ebf-4822-9f21-6387be0e7e04 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:31.357407 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-302bd0a6-3ebf-4822-9f21-6387be0e7e04 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:31.358165 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-302bd0a6-3ebf-4822-9f21-6387be0e7e04 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:31.358629 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-302bd0a6-3ebf-4822-9f21-6387be0e7e04 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:31.475479 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-302bd0a6-3ebf-4822-9f21-6387be0e7e04 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:31.483021 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-302bd0a6-3ebf-4822-9f21-6387be0e7e04 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:31.485439 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-302bd0a6-3ebf-4822-9f21-6387be0e7e04 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:31.486343 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-302bd0a6-3ebf-4822-9f21-6387be0e7e04 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.140168 Aug 19 09:26:31.486894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 573/1170] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:31 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:32.504907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-191f953c-a002-4ab0-9b27-c376be41d13b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:32.505534 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-191f953c-a002-4ab0-9b27-c376be41d13b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:32.511704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-191f953c-a002-4ab0-9b27-c376be41d13b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:32.512144 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-191f953c-a002-4ab0-9b27-c376be41d13b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:32.512900 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-191f953c-a002-4ab0-9b27-c376be41d13b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:32.513323 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-191f953c-a002-4ab0-9b27-c376be41d13b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:32.630704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-191f953c-a002-4ab0-9b27-c376be41d13b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:32.638156 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-191f953c-a002-4ab0-9b27-c376be41d13b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:32.639667 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-191f953c-a002-4ab0-9b27-c376be41d13b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:32.640928 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-191f953c-a002-4ab0-9b27-c376be41d13b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.139794 Aug 19 09:26:32.641465 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 598/1171] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:32 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:33.659697 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f2e2a029-f096-4668-b7e5-5d3d66c2bbf4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:33.660245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f2e2a029-f096-4668-b7e5-5d3d66c2bbf4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:33.666021 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2e2a029-f096-4668-b7e5-5d3d66c2bbf4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:33.666471 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2e2a029-f096-4668-b7e5-5d3d66c2bbf4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:33.667231 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2e2a029-f096-4668-b7e5-5d3d66c2bbf4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:33.667685 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f2e2a029-f096-4668-b7e5-5d3d66c2bbf4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:33.785007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f2e2a029-f096-4668-b7e5-5d3d66c2bbf4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:33.792690 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f2e2a029-f096-4668-b7e5-5d3d66c2bbf4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:33.794194 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f2e2a029-f096-4668-b7e5-5d3d66c2bbf4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:33.795353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f2e2a029-f096-4668-b7e5-5d3d66c2bbf4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.140008 Aug 19 09:26:33.795900 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 574/1172] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:33 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:34.812647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e0c9688f-59e4-4746-81ce-dbef4c5ad065 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:34.813245 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e0c9688f-59e4-4746-81ce-dbef4c5ad065 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:34.819218 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0c9688f-59e4-4746-81ce-dbef4c5ad065 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:34.819688 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0c9688f-59e4-4746-81ce-dbef4c5ad065 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:34.820439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0c9688f-59e4-4746-81ce-dbef4c5ad065 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:34.820870 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e0c9688f-59e4-4746-81ce-dbef4c5ad065 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:34.947942 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e0c9688f-59e4-4746-81ce-dbef4c5ad065 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:34.955501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e0c9688f-59e4-4746-81ce-dbef4c5ad065 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:34.956991 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e0c9688f-59e4-4746-81ce-dbef4c5ad065 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:34.958117 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e0c9688f-59e4-4746-81ce-dbef4c5ad065 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.149208 Aug 19 09:26:34.958673 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 599/1173] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:34 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:35.975775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7b1b18dc-390a-4f21-affb-d50dde7e9759 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:35.976315 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7b1b18dc-390a-4f21-affb-d50dde7e9759 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:35.981982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b1b18dc-390a-4f21-affb-d50dde7e9759 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:35.982421 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b1b18dc-390a-4f21-affb-d50dde7e9759 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:35.983167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b1b18dc-390a-4f21-affb-d50dde7e9759 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:35.983618 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b1b18dc-390a-4f21-affb-d50dde7e9759 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:36.104443 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7b1b18dc-390a-4f21-affb-d50dde7e9759 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:36.112544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7b1b18dc-390a-4f21-affb-d50dde7e9759 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:36.114043 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7b1b18dc-390a-4f21-affb-d50dde7e9759 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:36.115174 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7b1b18dc-390a-4f21-affb-d50dde7e9759 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.143409 Aug 19 09:26:36.115757 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 575/1174] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:35 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:37.133324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-686f01a4-6dcf-4313-9fd1-abfa5084eab4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:37.133925 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-686f01a4-6dcf-4313-9fd1-abfa5084eab4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:37.139700 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-686f01a4-6dcf-4313-9fd1-abfa5084eab4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:37.140136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-686f01a4-6dcf-4313-9fd1-abfa5084eab4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:37.140887 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-686f01a4-6dcf-4313-9fd1-abfa5084eab4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:37.141890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-686f01a4-6dcf-4313-9fd1-abfa5084eab4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:37.264209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-686f01a4-6dcf-4313-9fd1-abfa5084eab4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:37.272373 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-686f01a4-6dcf-4313-9fd1-abfa5084eab4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:37.273849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-686f01a4-6dcf-4313-9fd1-abfa5084eab4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:37.274969 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-686f01a4-6dcf-4313-9fd1-abfa5084eab4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.145339 Aug 19 09:26:37.275558 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 600/1175] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:37 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:38.293021 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-924b58be-09d5-49bb-b317-d8328771c63d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:38.293627 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-924b58be-09d5-49bb-b317-d8328771c63d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:38.300023 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-924b58be-09d5-49bb-b317-d8328771c63d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:38.300461 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-924b58be-09d5-49bb-b317-d8328771c63d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:38.301213 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-924b58be-09d5-49bb-b317-d8328771c63d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:38.301641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-924b58be-09d5-49bb-b317-d8328771c63d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:38.419168 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-924b58be-09d5-49bb-b317-d8328771c63d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:38.428118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-924b58be-09d5-49bb-b317-d8328771c63d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:38.429706 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-924b58be-09d5-49bb-b317-d8328771c63d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:38.430829 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-924b58be-09d5-49bb-b317-d8328771c63d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.141617 Aug 19 09:26:38.431438 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 576/1176] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:38 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:26:39.449619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b5eb749e-30cf-4b07-801f-27d6ff67d80d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:39.450252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b5eb749e-30cf-4b07-801f-27d6ff67d80d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:39.456211 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5eb749e-30cf-4b07-801f-27d6ff67d80d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:39.456653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5eb749e-30cf-4b07-801f-27d6ff67d80d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:39.457407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5eb749e-30cf-4b07-801f-27d6ff67d80d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:39.457840 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5eb749e-30cf-4b07-801f-27d6ff67d80d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:39.575972 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b5eb749e-30cf-4b07-801f-27d6ff67d80d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:39.583685 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b5eb749e-30cf-4b07-801f-27d6ff67d80d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:39.585169 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b5eb749e-30cf-4b07-801f-27d6ff67d80d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:39.586294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b5eb749e-30cf-4b07-801f-27d6ff67d80d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.140412 Aug 19 09:26:39.586849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 601/1177] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:39 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:40.604750 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-83193454-3e59-49a6-9e49-9a8f083e503b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:40.605351 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-83193454-3e59-49a6-9e49-9a8f083e503b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:40.612183 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-83193454-3e59-49a6-9e49-9a8f083e503b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:40.612625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-83193454-3e59-49a6-9e49-9a8f083e503b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:40.613380 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-83193454-3e59-49a6-9e49-9a8f083e503b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:40.613810 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-83193454-3e59-49a6-9e49-9a8f083e503b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:40.736461 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-83193454-3e59-49a6-9e49-9a8f083e503b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:40.743904 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-83193454-3e59-49a6-9e49-9a8f083e503b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:40.745376 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-83193454-3e59-49a6-9e49-9a8f083e503b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:40.746497 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-83193454-3e59-49a6-9e49-9a8f083e503b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.145440 Aug 19 09:26:40.747040 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 577/1178] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:40 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:26:41.765270 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-68088a44-1869-4d5e-9559-9d535a8e061b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:41.765807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-68088a44-1869-4d5e-9559-9d535a8e061b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:41.772535 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68088a44-1869-4d5e-9559-9d535a8e061b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:41.772984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68088a44-1869-4d5e-9559-9d535a8e061b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:41.773747 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68088a44-1869-4d5e-9559-9d535a8e061b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:41.774185 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68088a44-1869-4d5e-9559-9d535a8e061b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:41.898147 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-68088a44-1869-4d5e-9559-9d535a8e061b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:41.905640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-68088a44-1869-4d5e-9559-9d535a8e061b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:41.907795 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-68088a44-1869-4d5e-9559-9d535a8e061b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:41.908911 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-68088a44-1869-4d5e-9559-9d535a8e061b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1743 microversion: 2.20 time: 0.147416 Aug 19 09:26:41.909457 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 602/1179] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:41 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:42.926701 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6011514b-7aea-453a-9c17-4593cd3a1d34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:42.927353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6011514b-7aea-453a-9c17-4593cd3a1d34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:42.934038 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6011514b-7aea-453a-9c17-4593cd3a1d34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:42.934484 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6011514b-7aea-453a-9c17-4593cd3a1d34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:42.935248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6011514b-7aea-453a-9c17-4593cd3a1d34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:42.935710 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6011514b-7aea-453a-9c17-4593cd3a1d34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:43.064474 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6011514b-7aea-453a-9c17-4593cd3a1d34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:43.071980 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6011514b-7aea-453a-9c17-4593cd3a1d34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:43.073456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6011514b-7aea-453a-9c17-4593cd3a1d34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:43.074573 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6011514b-7aea-453a-9c17-4593cd3a1d34 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1743 microversion: 2.20 time: 0.152295 Aug 19 09:26:43.075117 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 578/1180] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:42 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:44.092760 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-dbe48db3-34a8-48fb-b5d0-d056ea953fe9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:44.093369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-dbe48db3-34a8-48fb-b5d0-d056ea953fe9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:44.099341 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbe48db3-34a8-48fb-b5d0-d056ea953fe9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:44.099781 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbe48db3-34a8-48fb-b5d0-d056ea953fe9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:44.100526 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbe48db3-34a8-48fb-b5d0-d056ea953fe9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:44.100955 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-dbe48db3-34a8-48fb-b5d0-d056ea953fe9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:44.219121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dbe48db3-34a8-48fb-b5d0-d056ea953fe9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:44.226971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dbe48db3-34a8-48fb-b5d0-d056ea953fe9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:44.228486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-dbe48db3-34a8-48fb-b5d0-d056ea953fe9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:44.229605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-dbe48db3-34a8-48fb-b5d0-d056ea953fe9 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1743 microversion: 2.20 time: 0.140550 Aug 19 09:26:44.230147 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 603/1181] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:44 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1743 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:45.248105 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0ec0dbf6-0cfc-47d4-be2e-87b470a4e4a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:45.248646 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0ec0dbf6-0cfc-47d4-be2e-87b470a4e4a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:45.255467 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ec0dbf6-0cfc-47d4-be2e-87b470a4e4a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:45.255914 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ec0dbf6-0cfc-47d4-be2e-87b470a4e4a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:45.256671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ec0dbf6-0cfc-47d4-be2e-87b470a4e4a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:45.257444 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0ec0dbf6-0cfc-47d4-be2e-87b470a4e4a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:45.383495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0ec0dbf6-0cfc-47d4-be2e-87b470a4e4a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:45.391030 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0ec0dbf6-0cfc-47d4-be2e-87b470a4e4a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:45.393344 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0ec0dbf6-0cfc-47d4-be2e-87b470a4e4a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:45.394469 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0ec0dbf6-0cfc-47d4-be2e-87b470a4e4a4 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1743 microversion: 2.20 time: 0.150099 Aug 19 09:26:45.395010 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 579/1182] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:45 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:46.411805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-24f301b9-da8b-4bc3-aaaa-5d41c9ad3aca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:46.412408 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-24f301b9-da8b-4bc3-aaaa-5d41c9ad3aca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:46.418221 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-24f301b9-da8b-4bc3-aaaa-5d41c9ad3aca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:46.418668 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-24f301b9-da8b-4bc3-aaaa-5d41c9ad3aca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:46.419544 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-24f301b9-da8b-4bc3-aaaa-5d41c9ad3aca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:46.419974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-24f301b9-da8b-4bc3-aaaa-5d41c9ad3aca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:46.544672 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-24f301b9-da8b-4bc3-aaaa-5d41c9ad3aca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:46.553308 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-24f301b9-da8b-4bc3-aaaa-5d41c9ad3aca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:46.554881 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-24f301b9-da8b-4bc3-aaaa-5d41c9ad3aca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:46.556122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-24f301b9-da8b-4bc3-aaaa-5d41c9ad3aca tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1743 microversion: 2.20 time: 0.148214 Aug 19 09:26:46.556744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 604/1183] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:46 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:46.609898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-a0278b2f-042d-42b4-b30e-99961071f6b7 req-e85b97ce-01b7-4bf3-8eb8-58853f595920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89098f09-c8cd-4e15-bef5-1bc104634225", "name": "network-vif-plugged", "status": "completed", "tag": "c72c5439-5706-4605-91f9-225118f3705b"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:26:46.612118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:26:46.612118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:26:46.619095 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-a0278b2f-042d-42b4-b30e-99961071f6b7 req-e85b97ce-01b7-4bf3-8eb8-58853f595920 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:46.619610 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-a0278b2f-042d-42b4-b30e-99961071f6b7 req-e85b97ce-01b7-4bf3-8eb8-58853f595920 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:46.632581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-a0278b2f-042d-42b4-b30e-99961071f6b7 req-e85b97ce-01b7-4bf3-8eb8-58853f595920 service nova] Creating event network-vif-plugged:c72c5439-5706-4605-91f9-225118f3705b for instance 89098f09-c8cd-4e15-bef5-1bc104634225 on hv-cinder-77387 Aug 19 09:26:46.637492 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-a0278b2f-042d-42b4-b30e-99961071f6b7 req-e85b97ce-01b7-4bf3-8eb8-58853f595920 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031172 Aug 19 09:26:46.638148 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 580/1184] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:26:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:26:47.574640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-70645d8b-ef62-4c1e-a3ea-9846f612b186 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:47.576067 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-70645d8b-ef62-4c1e-a3ea-9846f612b186 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:47.582812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70645d8b-ef62-4c1e-a3ea-9846f612b186 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:47.583416 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70645d8b-ef62-4c1e-a3ea-9846f612b186 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:47.584216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70645d8b-ef62-4c1e-a3ea-9846f612b186 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:47.584742 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70645d8b-ef62-4c1e-a3ea-9846f612b186 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:47.709706 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-70645d8b-ef62-4c1e-a3ea-9846f612b186 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:47.718008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-70645d8b-ef62-4c1e-a3ea-9846f612b186 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:47.719663 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-70645d8b-ef62-4c1e-a3ea-9846f612b186 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:47.721755 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-70645d8b-ef62-4c1e-a3ea-9846f612b186 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1738 microversion: 2.20 time: 0.150877 Aug 19 09:26:47.722314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 605/1185] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:47 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:48.740404 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-73b5691d-7198-4893-a322-a1376b6b5fac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:48.741857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-73b5691d-7198-4893-a322-a1376b6b5fac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:48.748125 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73b5691d-7198-4893-a322-a1376b6b5fac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:48.748647 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73b5691d-7198-4893-a322-a1376b6b5fac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:48.749485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73b5691d-7198-4893-a322-a1376b6b5fac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:48.750013 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-73b5691d-7198-4893-a322-a1376b6b5fac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:48.878403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-73b5691d-7198-4893-a322-a1376b6b5fac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:48.886899 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-73b5691d-7198-4893-a322-a1376b6b5fac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:48.888417 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-73b5691d-7198-4893-a322-a1376b6b5fac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:48.889547 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-73b5691d-7198-4893-a322-a1376b6b5fac tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1738 microversion: 2.20 time: 0.153182 Aug 19 09:26:48.890083 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 581/1186] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:48 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:49.907059 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4dbeeb66-a6dd-47fb-ab22-565fce9b2c82 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:49.908768 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4dbeeb66-a6dd-47fb-ab22-565fce9b2c82 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:49.915522 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4dbeeb66-a6dd-47fb-ab22-565fce9b2c82 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:49.916349 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4dbeeb66-a6dd-47fb-ab22-565fce9b2c82 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:49.917352 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4dbeeb66-a6dd-47fb-ab22-565fce9b2c82 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:49.918021 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4dbeeb66-a6dd-47fb-ab22-565fce9b2c82 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:50.049950 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4dbeeb66-a6dd-47fb-ab22-565fce9b2c82 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:50.057758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4dbeeb66-a6dd-47fb-ab22-565fce9b2c82 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:50.059252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4dbeeb66-a6dd-47fb-ab22-565fce9b2c82 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:50.060446 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4dbeeb66-a6dd-47fb-ab22-565fce9b2c82 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1738 microversion: 2.20 time: 0.157050 Aug 19 09:26:50.060996 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 606/1187] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:49 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:51.080436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-452d43da-d172-41d9-8737-39aad2969be0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:51.081841 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-452d43da-d172-41d9-8737-39aad2969be0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:51.088192 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-452d43da-d172-41d9-8737-39aad2969be0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:51.088713 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-452d43da-d172-41d9-8737-39aad2969be0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:51.090472 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-452d43da-d172-41d9-8737-39aad2969be0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:51.090472 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-452d43da-d172-41d9-8737-39aad2969be0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:51.214534 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-452d43da-d172-41d9-8737-39aad2969be0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:51.224159 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-452d43da-d172-41d9-8737-39aad2969be0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:51.225671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-452d43da-d172-41d9-8737-39aad2969be0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:51.226849 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-452d43da-d172-41d9-8737-39aad2969be0 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1738 microversion: 2.20 time: 0.150955 Aug 19 09:26:51.227443 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 582/1188] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:51 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:52.244956 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4494b16b-465b-4586-9992-76c2086a858b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:52.245580 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4494b16b-465b-4586-9992-76c2086a858b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:52.252568 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4494b16b-465b-4586-9992-76c2086a858b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:52.253053 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4494b16b-465b-4586-9992-76c2086a858b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:52.254700 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4494b16b-465b-4586-9992-76c2086a858b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:52.254894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4494b16b-465b-4586-9992-76c2086a858b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:52.390939 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4494b16b-465b-4586-9992-76c2086a858b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:52.399960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4494b16b-465b-4586-9992-76c2086a858b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:52.401437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4494b16b-465b-4586-9992-76c2086a858b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:52.402575 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4494b16b-465b-4586-9992-76c2086a858b tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1738 microversion: 2.20 time: 0.161307 Aug 19 09:26:52.403315 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 607/1189] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:52 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:53.421795 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2150aed3-f4e7-4050-ac59-a7826f902937 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:53.422411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2150aed3-f4e7-4050-ac59-a7826f902937 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:53.428952 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2150aed3-f4e7-4050-ac59-a7826f902937 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:53.429375 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2150aed3-f4e7-4050-ac59-a7826f902937 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:53.430202 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2150aed3-f4e7-4050-ac59-a7826f902937 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:53.430637 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2150aed3-f4e7-4050-ac59-a7826f902937 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:53.558187 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2150aed3-f4e7-4050-ac59-a7826f902937 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:53.567150 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2150aed3-f4e7-4050-ac59-a7826f902937 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:53.568682 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2150aed3-f4e7-4050-ac59-a7826f902937 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:53.569921 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2150aed3-f4e7-4050-ac59-a7826f902937 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1738 microversion: 2.20 time: 0.152265 Aug 19 09:26:53.570496 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 583/1190] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:53 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:54.590549 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-bd6598ab-696d-491e-8077-62d97e469b0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:54.591300 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-bd6598ab-696d-491e-8077-62d97e469b0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:54.598324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd6598ab-696d-491e-8077-62d97e469b0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:54.598782 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd6598ab-696d-491e-8077-62d97e469b0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:54.599584 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd6598ab-696d-491e-8077-62d97e469b0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:54.600019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bd6598ab-696d-491e-8077-62d97e469b0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:54.736479 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-bd6598ab-696d-491e-8077-62d97e469b0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:54.744375 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-bd6598ab-696d-491e-8077-62d97e469b0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:54.745943 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-bd6598ab-696d-491e-8077-62d97e469b0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:54.747078 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-bd6598ab-696d-491e-8077-62d97e469b0f tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1738 microversion: 2.20 time: 0.162539 Aug 19 09:26:54.748025 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 608/1191] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:54 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:55.765662 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b2161af3-0e23-4bb4-ada3-a77ad91468bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:55.766207 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b2161af3-0e23-4bb4-ada3-a77ad91468bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:55.772478 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2161af3-0e23-4bb4-ada3-a77ad91468bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:55.772934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2161af3-0e23-4bb4-ada3-a77ad91468bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:55.773695 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2161af3-0e23-4bb4-ada3-a77ad91468bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:55.774125 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b2161af3-0e23-4bb4-ada3-a77ad91468bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:55.908411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b2161af3-0e23-4bb4-ada3-a77ad91468bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:55.916588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b2161af3-0e23-4bb4-ada3-a77ad91468bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:55.918296 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b2161af3-0e23-4bb4-ada3-a77ad91468bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:55.919322 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b2161af3-0e23-4bb4-ada3-a77ad91468bd tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1738 microversion: 2.20 time: 0.157418 Aug 19 09:26:55.931354 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 584/1192] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:55 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:56.937587 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cacfb6f6-84ed-495f-a757-c776ea276dc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:56.938740 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cacfb6f6-84ed-495f-a757-c776ea276dc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:56.944918 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cacfb6f6-84ed-495f-a757-c776ea276dc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:56.945646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cacfb6f6-84ed-495f-a757-c776ea276dc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:56.946637 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cacfb6f6-84ed-495f-a757-c776ea276dc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:56.947355 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cacfb6f6-84ed-495f-a757-c776ea276dc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:57.082960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cacfb6f6-84ed-495f-a757-c776ea276dc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:57.090451 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cacfb6f6-84ed-495f-a757-c776ea276dc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:57.092214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-cacfb6f6-84ed-495f-a757-c776ea276dc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:57.093590 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cacfb6f6-84ed-495f-a757-c776ea276dc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1738 microversion: 2.20 time: 0.159561 Aug 19 09:26:57.094228 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 609/1193] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:56 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:58.113351 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5a3ecb38-1fe2-483e-ad63-2bdc9e586398 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:58.113947 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5a3ecb38-1fe2-483e-ad63-2bdc9e586398 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:58.120062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5a3ecb38-1fe2-483e-ad63-2bdc9e586398 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:58.120502 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5a3ecb38-1fe2-483e-ad63-2bdc9e586398 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:58.121261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5a3ecb38-1fe2-483e-ad63-2bdc9e586398 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:58.121686 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5a3ecb38-1fe2-483e-ad63-2bdc9e586398 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:58.341565 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5a3ecb38-1fe2-483e-ad63-2bdc9e586398 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:58.350322 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5a3ecb38-1fe2-483e-ad63-2bdc9e586398 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:58.351876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5a3ecb38-1fe2-483e-ad63-2bdc9e586398 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:58.353023 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5a3ecb38-1fe2-483e-ad63-2bdc9e586398 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1720 microversion: 2.20 time: 0.244092 Aug 19 09:26:58.353574 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 585/1194] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:58 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1720 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:26:59.371769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fb889560-3265-4823-897f-82d494b3464d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:26:59.372409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fb889560-3265-4823-897f-82d494b3464d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:26:59.379104 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fb889560-3265-4823-897f-82d494b3464d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:59.379633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fb889560-3265-4823-897f-82d494b3464d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:59.380401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fb889560-3265-4823-897f-82d494b3464d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:26:59.380829 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fb889560-3265-4823-897f-82d494b3464d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:26:59.497785 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fb889560-3265-4823-897f-82d494b3464d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:59.505558 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fb889560-3265-4823-897f-82d494b3464d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:59.507045 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fb889560-3265-4823-897f-82d494b3464d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:26:59.508197 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fb889560-3265-4823-897f-82d494b3464d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1720 microversion: 2.20 time: 0.140098 Aug 19 09:26:59.508742 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 610/1195] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:26:59 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1720 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:00.525954 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b3dc022f-4d28-42de-ba2a-40d1645616fc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:00.526579 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b3dc022f-4d28-42de-ba2a-40d1645616fc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:00.532970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b3dc022f-4d28-42de-ba2a-40d1645616fc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:00.533418 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b3dc022f-4d28-42de-ba2a-40d1645616fc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:00.534155 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b3dc022f-4d28-42de-ba2a-40d1645616fc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:00.534580 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b3dc022f-4d28-42de-ba2a-40d1645616fc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:00.651851 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b3dc022f-4d28-42de-ba2a-40d1645616fc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:00.659410 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b3dc022f-4d28-42de-ba2a-40d1645616fc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:00.660916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-b3dc022f-4d28-42de-ba2a-40d1645616fc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:00.662035 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b3dc022f-4d28-42de-ba2a-40d1645616fc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1723 microversion: 2.20 time: 0.139786 Aug 19 09:27:00.662586 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 586/1196] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:00 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:00.679639 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0d06345a-4ffd-4523-bf7f-6f9e4d193cc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d9d7579-aa6e-422c-b3fc-bf0b42c67e9c"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:00.680727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0d06345a-4ffd-4523-bf7f-6f9e4d193cc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:00.686309 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d06345a-4ffd-4523-bf7f-6f9e4d193cc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:00.686752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d06345a-4ffd-4523-bf7f-6f9e4d193cc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:00.687527 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d06345a-4ffd-4523-bf7f-6f9e4d193cc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:00.687955 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0d06345a-4ffd-4523-bf7f-6f9e4d193cc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:00.951455 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0d06345a-4ffd-4523-bf7f-6f9e4d193cc3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.275517 Aug 19 09:27:00.952046 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 611/1197] 10.222.0.32 () {62 vars in 1364 bytes} [Thu Aug 19 09:27:00 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/os-volume_attachments => generated 188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:27:01.070704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-24bdac9b-a487-4d79-998d-dfdb85f3a844 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:01.071194 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-24bdac9b-a487-4d79-998d-dfdb85f3a844 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:01.077180 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24bdac9b-a487-4d79-998d-dfdb85f3a844 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:01.077760 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24bdac9b-a487-4d79-998d-dfdb85f3a844 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:01.078712 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24bdac9b-a487-4d79-998d-dfdb85f3a844 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:01.079876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24bdac9b-a487-4d79-998d-dfdb85f3a844 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:01.312581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-24bdac9b-a487-4d79-998d-dfdb85f3a844 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "DELETE /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/os-volume_attachments/6d9d7579-aa6e-422c-b3fc-bf0b42c67e9c" status: 202 len: 0 microversion: 2.20 time: 0.245547 Aug 19 09:27:01.313733 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 587/1198] 10.222.0.32 () {60 vars in 1457 bytes} [Thu Aug 19 09:27:01 2021] DELETE /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/os-volume_attachments/6d9d7579-aa6e-422c-b3fc-bf0b42c67e9c => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:27:01.372087 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9cc3644e-090f-4d3e-bf96-bd316cad07b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:01.372648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9cc3644e-090f-4d3e-bf96-bd316cad07b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:01.380010 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9cc3644e-090f-4d3e-bf96-bd316cad07b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:01.380487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9cc3644e-090f-4d3e-bf96-bd316cad07b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:01.381276 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9cc3644e-090f-4d3e-bf96-bd316cad07b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:01.381698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9cc3644e-090f-4d3e-bf96-bd316cad07b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:01.454419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9cc3644e-090f-4d3e-bf96-bd316cad07b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action" status: 202 len: 0 microversion: 2.20 time: 0.085795 Aug 19 09:27:01.454893 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 612/1199] 10.222.0.32 () {62 vars in 1319 bytes} [Thu Aug 19 09:27:01 2021] POST /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:27:01.462656 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-054af3c0-5981-46ab-b623-7859929ea4f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:01.463258 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-054af3c0-5981-46ab-b623-7859929ea4f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:01.469063 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-054af3c0-5981-46ab-b623-7859929ea4f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:01.469542 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-054af3c0-5981-46ab-b623-7859929ea4f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:01.470298 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-054af3c0-5981-46ab-b623-7859929ea4f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:01.470726 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-054af3c0-5981-46ab-b623-7859929ea4f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:01.624548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-054af3c0-5981-46ab-b623-7859929ea4f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:01.633683 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-054af3c0-5981-46ab-b623-7859929ea4f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:01.635156 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-054af3c0-5981-46ab-b623-7859929ea4f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:01.636372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-054af3c0-5981-46ab-b623-7859929ea4f6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1671 microversion: 2.20 time: 0.177376 Aug 19 09:27:01.636921 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 588/1200] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:01 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:27:02.579881 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-c0a1826f-7d9a-4ef0-bd03-9559d5dbe8de req-e53fcc3b-3f07-4ab0-8d8e-e37455be08d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89098f09-c8cd-4e15-bef5-1bc104634225", "name": "network-vif-unplugged", "status": "completed", "tag": "c72c5439-5706-4605-91f9-225118f3705b"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:02.582027 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:27:02.582027 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:27:02.589611 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-c0a1826f-7d9a-4ef0-bd03-9559d5dbe8de req-e53fcc3b-3f07-4ab0-8d8e-e37455be08d4 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:02.590076 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-c0a1826f-7d9a-4ef0-bd03-9559d5dbe8de req-e53fcc3b-3f07-4ab0-8d8e-e37455be08d4 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:02.605501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-c0a1826f-7d9a-4ef0-bd03-9559d5dbe8de req-e53fcc3b-3f07-4ab0-8d8e-e37455be08d4 service nova] Creating event network-vif-unplugged:c72c5439-5706-4605-91f9-225118f3705b for instance 89098f09-c8cd-4e15-bef5-1bc104634225 on hv-cinder-77387 Aug 19 09:27:02.611809 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-c0a1826f-7d9a-4ef0-bd03-9559d5dbe8de req-e53fcc3b-3f07-4ab0-8d8e-e37455be08d4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035710 Aug 19 09:27:02.612802 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 613/1201] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:27:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:27:02.654008 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c1d84c7b-2c4e-43f0-8248-5c48c8b2f197 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:02.654694 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c1d84c7b-2c4e-43f0-8248-5c48c8b2f197 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:02.661435 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c1d84c7b-2c4e-43f0-8248-5c48c8b2f197 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:02.661876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c1d84c7b-2c4e-43f0-8248-5c48c8b2f197 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:02.662638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c1d84c7b-2c4e-43f0-8248-5c48c8b2f197 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:02.663093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c1d84c7b-2c4e-43f0-8248-5c48c8b2f197 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:02.855518 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c1d84c7b-2c4e-43f0-8248-5c48c8b2f197 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:02.864077 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c1d84c7b-2c4e-43f0-8248-5c48c8b2f197 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:02.865560 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c1d84c7b-2c4e-43f0-8248-5c48c8b2f197 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:02.866681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c1d84c7b-2c4e-43f0-8248-5c48c8b2f197 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.216491 Aug 19 09:27:02.867226 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 589/1202] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:02 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:03.885744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1cd9dec4-486f-4a33-86fe-c41c0fe3dd0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:03.886439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1cd9dec4-486f-4a33-86fe-c41c0fe3dd0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:03.893479 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cd9dec4-486f-4a33-86fe-c41c0fe3dd0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:03.893922 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cd9dec4-486f-4a33-86fe-c41c0fe3dd0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:03.894688 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cd9dec4-486f-4a33-86fe-c41c0fe3dd0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:03.895121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1cd9dec4-486f-4a33-86fe-c41c0fe3dd0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:04.026397 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1cd9dec4-486f-4a33-86fe-c41c0fe3dd0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:04.034503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1cd9dec4-486f-4a33-86fe-c41c0fe3dd0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:04.036033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-1cd9dec4-486f-4a33-86fe-c41c0fe3dd0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:04.037164 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1cd9dec4-486f-4a33-86fe-c41c0fe3dd0a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.155490 Aug 19 09:27:04.037722 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 614/1203] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:03 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:05.056263 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-47cd2438-e868-4fc0-a489-c5809261b822 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:05.056929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-47cd2438-e868-4fc0-a489-c5809261b822 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:05.063111 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47cd2438-e868-4fc0-a489-c5809261b822 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:05.063593 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47cd2438-e868-4fc0-a489-c5809261b822 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:05.064415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47cd2438-e868-4fc0-a489-c5809261b822 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:05.064876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47cd2438-e868-4fc0-a489-c5809261b822 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:05.189804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-47cd2438-e868-4fc0-a489-c5809261b822 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:05.198151 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-47cd2438-e868-4fc0-a489-c5809261b822 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:05.199999 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-47cd2438-e868-4fc0-a489-c5809261b822 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:05.201722 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-47cd2438-e868-4fc0-a489-c5809261b822 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.149826 Aug 19 09:27:05.214975 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 590/1204] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:05 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:06.224043 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f9830521-1a85-41d6-8784-99618a06d859 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:06.224656 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f9830521-1a85-41d6-8784-99618a06d859 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:06.230517 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9830521-1a85-41d6-8784-99618a06d859 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:06.231179 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9830521-1a85-41d6-8784-99618a06d859 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:06.231961 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9830521-1a85-41d6-8784-99618a06d859 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:06.232389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f9830521-1a85-41d6-8784-99618a06d859 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:06.363387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f9830521-1a85-41d6-8784-99618a06d859 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:06.371952 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f9830521-1a85-41d6-8784-99618a06d859 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:06.373935 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f9830521-1a85-41d6-8784-99618a06d859 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:06.375152 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f9830521-1a85-41d6-8784-99618a06d859 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.155605 Aug 19 09:27:06.376850 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 615/1205] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:06 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:07.399509 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-47d4be2b-30ae-4364-804b-8ec8b557f8bc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:07.400113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-47d4be2b-30ae-4364-804b-8ec8b557f8bc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:07.405925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47d4be2b-30ae-4364-804b-8ec8b557f8bc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:07.406365 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47d4be2b-30ae-4364-804b-8ec8b557f8bc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:07.407303 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47d4be2b-30ae-4364-804b-8ec8b557f8bc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:07.407907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-47d4be2b-30ae-4364-804b-8ec8b557f8bc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:07.536641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-47d4be2b-30ae-4364-804b-8ec8b557f8bc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:07.546259 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-47d4be2b-30ae-4364-804b-8ec8b557f8bc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:07.548582 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-47d4be2b-30ae-4364-804b-8ec8b557f8bc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:07.549791 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-47d4be2b-30ae-4364-804b-8ec8b557f8bc tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.153921 Aug 19 09:27:07.550525 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 591/1206] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:07 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:08.568773 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-98501e08-d2a3-46d6-a12a-edb80a20bf53 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:08.569382 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-98501e08-d2a3-46d6-a12a-edb80a20bf53 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:08.575241 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98501e08-d2a3-46d6-a12a-edb80a20bf53 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:08.575716 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98501e08-d2a3-46d6-a12a-edb80a20bf53 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:08.576484 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98501e08-d2a3-46d6-a12a-edb80a20bf53 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:08.576922 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98501e08-d2a3-46d6-a12a-edb80a20bf53 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:08.709309 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-98501e08-d2a3-46d6-a12a-edb80a20bf53 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:08.717374 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-98501e08-d2a3-46d6-a12a-edb80a20bf53 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:08.718896 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-98501e08-d2a3-46d6-a12a-edb80a20bf53 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:08.720952 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-98501e08-d2a3-46d6-a12a-edb80a20bf53 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.155807 Aug 19 09:27:08.721858 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 616/1207] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:08 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:09.740751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e5befaa5-06c6-4ffd-9803-832193dc20b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:09.742123 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e5befaa5-06c6-4ffd-9803-832193dc20b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:09.749076 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e5befaa5-06c6-4ffd-9803-832193dc20b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:09.751330 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e5befaa5-06c6-4ffd-9803-832193dc20b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:09.752372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e5befaa5-06c6-4ffd-9803-832193dc20b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:09.752807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e5befaa5-06c6-4ffd-9803-832193dc20b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:09.879079 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e5befaa5-06c6-4ffd-9803-832193dc20b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:09.886656 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e5befaa5-06c6-4ffd-9803-832193dc20b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:09.888178 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e5befaa5-06c6-4ffd-9803-832193dc20b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:09.889302 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e5befaa5-06c6-4ffd-9803-832193dc20b3 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.152911 Aug 19 09:27:09.889853 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 592/1208] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:09 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:10.907883 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e29e930e-6de8-455d-a20d-42a15beb3488 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:10.908694 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e29e930e-6de8-455d-a20d-42a15beb3488 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:10.915423 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e29e930e-6de8-455d-a20d-42a15beb3488 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:10.915872 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e29e930e-6de8-455d-a20d-42a15beb3488 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:10.916646 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e29e930e-6de8-455d-a20d-42a15beb3488 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:10.917083 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e29e930e-6de8-455d-a20d-42a15beb3488 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:11.048436 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e29e930e-6de8-455d-a20d-42a15beb3488 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:11.056082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e29e930e-6de8-455d-a20d-42a15beb3488 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:11.057565 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e29e930e-6de8-455d-a20d-42a15beb3488 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:11.058684 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e29e930e-6de8-455d-a20d-42a15beb3488 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.155034 Aug 19 09:27:11.059234 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 617/1209] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:10 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:12.077807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6a5b4d4d-5c74-409b-a24e-43d0b62b4232 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:12.079224 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6a5b4d4d-5c74-409b-a24e-43d0b62b4232 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:12.088183 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6a5b4d4d-5c74-409b-a24e-43d0b62b4232 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:12.100005 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6a5b4d4d-5c74-409b-a24e-43d0b62b4232 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:12.100872 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6a5b4d4d-5c74-409b-a24e-43d0b62b4232 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:12.101193 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6a5b4d4d-5c74-409b-a24e-43d0b62b4232 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:12.223910 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6a5b4d4d-5c74-409b-a24e-43d0b62b4232 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:12.232283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6a5b4d4d-5c74-409b-a24e-43d0b62b4232 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:12.233840 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6a5b4d4d-5c74-409b-a24e-43d0b62b4232 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:12.236383 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6a5b4d4d-5c74-409b-a24e-43d0b62b4232 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.162050 Aug 19 09:27:12.236956 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 593/1210] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:12 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:13.254690 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-13280d4a-bc97-4aa8-b497-91bd92238bfe tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:13.255292 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-13280d4a-bc97-4aa8-b497-91bd92238bfe tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:13.261084 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13280d4a-bc97-4aa8-b497-91bd92238bfe tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:13.261528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13280d4a-bc97-4aa8-b497-91bd92238bfe tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:13.262279 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13280d4a-bc97-4aa8-b497-91bd92238bfe tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:13.262709 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-13280d4a-bc97-4aa8-b497-91bd92238bfe tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:13.395899 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-13280d4a-bc97-4aa8-b497-91bd92238bfe tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:13.407317 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-13280d4a-bc97-4aa8-b497-91bd92238bfe tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:13.409548 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-13280d4a-bc97-4aa8-b497-91bd92238bfe tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:13.411191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-13280d4a-bc97-4aa8-b497-91bd92238bfe tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.160088 Aug 19 09:27:13.412482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 618/1211] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:13 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:14.429369 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-38ea107a-bae3-4435-9e0e-4f4c43007fa5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:14.429991 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-38ea107a-bae3-4435-9e0e-4f4c43007fa5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:14.435845 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38ea107a-bae3-4435-9e0e-4f4c43007fa5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:14.436317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38ea107a-bae3-4435-9e0e-4f4c43007fa5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:14.437109 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38ea107a-bae3-4435-9e0e-4f4c43007fa5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:14.437576 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-38ea107a-bae3-4435-9e0e-4f4c43007fa5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:14.558319 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-38ea107a-bae3-4435-9e0e-4f4c43007fa5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:14.566313 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-38ea107a-bae3-4435-9e0e-4f4c43007fa5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:14.567817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-38ea107a-bae3-4435-9e0e-4f4c43007fa5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:14.568929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-38ea107a-bae3-4435-9e0e-4f4c43007fa5 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.143322 Aug 19 09:27:14.569964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 594/1212] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:14 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:15.587776 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ebcd1c00-4983-4547-a9a0-44c23bbc0dd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:15.588413 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ebcd1c00-4983-4547-a9a0-44c23bbc0dd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:15.594704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ebcd1c00-4983-4547-a9a0-44c23bbc0dd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:15.595143 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ebcd1c00-4983-4547-a9a0-44c23bbc0dd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:15.595930 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ebcd1c00-4983-4547-a9a0-44c23bbc0dd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:15.596364 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ebcd1c00-4983-4547-a9a0-44c23bbc0dd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:15.713893 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ebcd1c00-4983-4547-a9a0-44c23bbc0dd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:15.722192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ebcd1c00-4983-4547-a9a0-44c23bbc0dd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:15.723986 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ebcd1c00-4983-4547-a9a0-44c23bbc0dd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:15.725114 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ebcd1c00-4983-4547-a9a0-44c23bbc0dd1 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.141004 Aug 19 09:27:15.725734 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 619/1213] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:15 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:16.743571 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8fe5c1ab-a97c-4c80-948b-fd1dbb0fc4d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:16.744174 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8fe5c1ab-a97c-4c80-948b-fd1dbb0fc4d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:16.750460 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8fe5c1ab-a97c-4c80-948b-fd1dbb0fc4d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:16.751003 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8fe5c1ab-a97c-4c80-948b-fd1dbb0fc4d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:16.751783 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8fe5c1ab-a97c-4c80-948b-fd1dbb0fc4d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:16.752217 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8fe5c1ab-a97c-4c80-948b-fd1dbb0fc4d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:16.873484 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8fe5c1ab-a97c-4c80-948b-fd1dbb0fc4d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:16.881873 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8fe5c1ab-a97c-4c80-948b-fd1dbb0fc4d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:16.883388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8fe5c1ab-a97c-4c80-948b-fd1dbb0fc4d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:16.884511 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8fe5c1ab-a97c-4c80-948b-fd1dbb0fc4d7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.144666 Aug 19 09:27:16.885049 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 595/1214] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:16 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:17.909393 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5c5bab07-f829-4006-8dc6-3aeedd445121 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:17.909992 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5c5bab07-f829-4006-8dc6-3aeedd445121 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:17.915843 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c5bab07-f829-4006-8dc6-3aeedd445121 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:17.916295 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c5bab07-f829-4006-8dc6-3aeedd445121 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:17.917061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c5bab07-f829-4006-8dc6-3aeedd445121 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:17.917498 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c5bab07-f829-4006-8dc6-3aeedd445121 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:18.040889 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5c5bab07-f829-4006-8dc6-3aeedd445121 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:18.048753 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5c5bab07-f829-4006-8dc6-3aeedd445121 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:18.050233 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5c5bab07-f829-4006-8dc6-3aeedd445121 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:18.051387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5c5bab07-f829-4006-8dc6-3aeedd445121 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.146902 Aug 19 09:27:18.051917 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 620/1215] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:17 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:18.464562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f9eff828-eb65-4ab7-b3bb-ea9bca3691f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:18.465523 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f9eff828-eb65-4ab7-b3bb-ea9bca3691f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:18.471852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f9eff828-eb65-4ab7-b3bb-ea9bca3691f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:18.472295 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f9eff828-eb65-4ab7-b3bb-ea9bca3691f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:18.473343 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f9eff828-eb65-4ab7-b3bb-ea9bca3691f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:18.473776 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f9eff828-eb65-4ab7-b3bb-ea9bca3691f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:18.501958 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f9eff828-eb65-4ab7-b3bb-ea9bca3691f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041068 Aug 19 09:27:18.502489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 596/1216] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:27:18 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:18.559564 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-68c059d9-a82e-475e-b079-31bd32262c1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:18.560053 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-68c059d9-a82e-475e-b079-31bd32262c1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:18.566135 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68c059d9-a82e-475e-b079-31bd32262c1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:18.566573 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68c059d9-a82e-475e-b079-31bd32262c1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:18.567342 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68c059d9-a82e-475e-b079-31bd32262c1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:18.567775 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-68c059d9-a82e-475e-b079-31bd32262c1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:18.592669 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-68c059d9-a82e-475e-b079-31bd32262c1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Going to try to terminate instance {{(pid=107957) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:27:18.664433 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-68c059d9-a82e-475e-b079-31bd32262c1a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 204 len: 0 microversion: 2.1 time: 0.108170 Aug 19 09:27:18.665008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 621/1217] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:27:18 2021] DELETE /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:27:18.673164 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ed48750d-9f72-42a2-a0b3-6e89ea1dd565 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:18.673768 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ed48750d-9f72-42a2-a0b3-6e89ea1dd565 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:18.679403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ed48750d-9f72-42a2-a0b3-6e89ea1dd565 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:18.679856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ed48750d-9f72-42a2-a0b3-6e89ea1dd565 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:18.680602 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ed48750d-9f72-42a2-a0b3-6e89ea1dd565 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:18.681024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ed48750d-9f72-42a2-a0b3-6e89ea1dd565 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:18.798165 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ed48750d-9f72-42a2-a0b3-6e89ea1dd565 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:18.805415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ed48750d-9f72-42a2-a0b3-6e89ea1dd565 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1674 microversion: 2.1 time: 0.136083 Aug 19 09:27:18.805964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 597/1218] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:18 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1674 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:19.069425 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9c05008a-d95b-4484-af43-f08a31fe657a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:19.070051 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9c05008a-d95b-4484-af43-f08a31fe657a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:19.075810 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9c05008a-d95b-4484-af43-f08a31fe657a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:19.076450 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9c05008a-d95b-4484-af43-f08a31fe657a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:19.077330 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9c05008a-d95b-4484-af43-f08a31fe657a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:19.077877 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9c05008a-d95b-4484-af43-f08a31fe657a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:19.198304 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9c05008a-d95b-4484-af43-f08a31fe657a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:19.206515 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9c05008a-d95b-4484-af43-f08a31fe657a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:19.208036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9c05008a-d95b-4484-af43-f08a31fe657a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:19.209158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9c05008a-d95b-4484-af43-f08a31fe657a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.143852 Aug 19 09:27:19.209709 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 622/1219] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:19 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:19.822607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-24768966-25f4-4e86-becc-915d47bdbe0e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:19.823130 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-24768966-25f4-4e86-becc-915d47bdbe0e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:19.829063 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24768966-25f4-4e86-becc-915d47bdbe0e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:19.829508 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24768966-25f4-4e86-becc-915d47bdbe0e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:19.830275 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24768966-25f4-4e86-becc-915d47bdbe0e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:19.830707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24768966-25f4-4e86-becc-915d47bdbe0e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:19.958340 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-24768966-25f4-4e86-becc-915d47bdbe0e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:19.980245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-24768966-25f4-4e86-becc-915d47bdbe0e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1674 microversion: 2.1 time: 0.161052 Aug 19 09:27:19.981238 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 598/1220] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:19 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:20.227482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-49d088c8-6ee4-45e0-8b07-57dc0e0eb144 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:20.228066 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-49d088c8-6ee4-45e0-8b07-57dc0e0eb144 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:20.233698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-49d088c8-6ee4-45e0-8b07-57dc0e0eb144 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:20.234137 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-49d088c8-6ee4-45e0-8b07-57dc0e0eb144 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:20.235111 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-49d088c8-6ee4-45e0-8b07-57dc0e0eb144 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:20.235546 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-49d088c8-6ee4-45e0-8b07-57dc0e0eb144 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:20.355886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-49d088c8-6ee4-45e0-8b07-57dc0e0eb144 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:20.363718 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-49d088c8-6ee4-45e0-8b07-57dc0e0eb144 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:20.365212 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-49d088c8-6ee4-45e0-8b07-57dc0e0eb144 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:20.366344 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-49d088c8-6ee4-45e0-8b07-57dc0e0eb144 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.142522 Aug 19 09:27:20.366906 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 623/1221] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:20 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:21.004096 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-161f679c-e7bc-4abe-ac60-fa2897404992 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:21.004705 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-161f679c-e7bc-4abe-ac60-fa2897404992 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:21.010516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-161f679c-e7bc-4abe-ac60-fa2897404992 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:21.010956 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-161f679c-e7bc-4abe-ac60-fa2897404992 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:21.011756 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-161f679c-e7bc-4abe-ac60-fa2897404992 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:21.012185 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-161f679c-e7bc-4abe-ac60-fa2897404992 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:21.073115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-161f679c-e7bc-4abe-ac60-fa2897404992 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:21.081772 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-161f679c-e7bc-4abe-ac60-fa2897404992 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 200 len: 1607 microversion: 2.1 time: 0.081326 Aug 19 09:27:21.082371 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 599/1222] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:20 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 1607 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:21.223793 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-92946278-2d61-46b0-92b9-cb81bdef3e07 req-c6410044-afcc-426d-94dd-b0e104ecbc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424", "name": "network-vif-deleted", "tag": "f2ce61e2-8fd3-4bf9-b651-e4a66eec2886"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:21.225440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:27:21.225440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:27:21.232348 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-92946278-2d61-46b0-92b9-cb81bdef3e07 req-c6410044-afcc-426d-94dd-b0e104ecbc1f service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:21.232934 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-92946278-2d61-46b0-92b9-cb81bdef3e07 req-c6410044-afcc-426d-94dd-b0e104ecbc1f service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:21.244268 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-92946278-2d61-46b0-92b9-cb81bdef3e07 req-c6410044-afcc-426d-94dd-b0e104ecbc1f service nova] Creating event network-vif-deleted:f2ce61e2-8fd3-4bf9-b651-e4a66eec2886 for instance 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 on hv-cinder-77387 Aug 19 09:27:21.248967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-92946278-2d61-46b0-92b9-cb81bdef3e07 req-c6410044-afcc-426d-94dd-b0e104ecbc1f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030045 Aug 19 09:27:21.250387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 624/1223] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:27:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:27:21.386592 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8f7a3d35-0a19-4766-8cf2-114381cd0699 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:21.387772 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8f7a3d35-0a19-4766-8cf2-114381cd0699 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:21.397541 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8f7a3d35-0a19-4766-8cf2-114381cd0699 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:21.397984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8f7a3d35-0a19-4766-8cf2-114381cd0699 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:21.398762 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8f7a3d35-0a19-4766-8cf2-114381cd0699 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:21.399188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8f7a3d35-0a19-4766-8cf2-114381cd0699 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:21.521273 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8f7a3d35-0a19-4766-8cf2-114381cd0699 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:21.529304 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8f7a3d35-0a19-4766-8cf2-114381cd0699 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:21.530852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8f7a3d35-0a19-4766-8cf2-114381cd0699 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:21.532093 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8f7a3d35-0a19-4766-8cf2-114381cd0699 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.150868 Aug 19 09:27:21.532639 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 600/1224] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:21 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:27:22.099645 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9ee929be-389b-442f-aa89-25ae6d4f2682 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:22.100615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9ee929be-389b-442f-aa89-25ae6d4f2682 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:22.106862 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9ee929be-389b-442f-aa89-25ae6d4f2682 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:22.107701 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9ee929be-389b-442f-aa89-25ae6d4f2682 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:22.108089 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9ee929be-389b-442f-aa89-25ae6d4f2682 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:22.108514 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9ee929be-389b-442f-aa89-25ae6d4f2682 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:22.123051 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-9ee929be-389b-442f-aa89-25ae6d4f2682 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] HTTP exception thrown: Instance 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 could not be found. Aug 19 09:27:22.126564 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9ee929be-389b-442f-aa89-25ae6d4f2682 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Returning 404 to user: Instance 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:27:22.127762 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9ee929be-389b-442f-aa89-25ae6d4f2682 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 404 len: 111 microversion: 2.1 time: 0.032607 Aug 19 09:27:22.128516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 625/1225] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:22 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:27:22.136186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2ceb8d18-ebed-40d2-a775-f1bd30579da8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '.version_select at 0x7fdb804cbca0>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:22.139390 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ceb8d18-ebed-40d2-a775-f1bd30579da8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [1fbe930b-dc1a-4b24-a295-2785b8b02c16] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 09:27:22.550264 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c47ee1d8-48c4-4222-a0f8-ef19a4e84217 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:22.550880 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c47ee1d8-48c4-4222-a0f8-ef19a4e84217 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:22.557487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c47ee1d8-48c4-4222-a0f8-ef19a4e84217 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:22.557937 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c47ee1d8-48c4-4222-a0f8-ef19a4e84217 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:22.558713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c47ee1d8-48c4-4222-a0f8-ef19a4e84217 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:22.559149 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c47ee1d8-48c4-4222-a0f8-ef19a4e84217 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:22.804675 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c47ee1d8-48c4-4222-a0f8-ef19a4e84217 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:22.812800 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c47ee1d8-48c4-4222-a0f8-ef19a4e84217 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:22.814300 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c47ee1d8-48c4-4222-a0f8-ef19a4e84217 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:22.815486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c47ee1d8-48c4-4222-a0f8-ef19a4e84217 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1729 microversion: 2.20 time: 0.269436 Aug 19 09:27:22.816024 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 626/1226] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:22 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1729 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:27:23.155242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ceb8d18-ebed-40d2-a775-f1bd30579da8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [1fbe930b-dc1a-4b24-a295-2785b8b02c16] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 35266. Aug 19 09:27:23.173649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2ceb8d18-ebed-40d2-a775-f1bd30579da8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175985524" status: 202 len: 0 microversion: 2.1 time: 1.040986 Aug 19 09:27:23.174217 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 601/1227] 10.222.0.32 () {58 vars in 1221 bytes} [Thu Aug 19 09:27:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175985524 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:27:23.412866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:27:23.413086 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:27:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:27:23.833113 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-466d588d-450c-4bd7-a8df-72a4e2e2bd81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'create', calling method: .version_select at 0x7fdb803a9160>, body: {"keypair": {"name": "tempest-keypair-1754181333"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:23.833662 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-61de829d-2991-47c5-8aa0-951fc9783866 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:23.833982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-61de829d-2991-47c5-8aa0-951fc9783866 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:23.841967 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-61de829d-2991-47c5-8aa0-951fc9783866 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:23.842407 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-61de829d-2991-47c5-8aa0-951fc9783866 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:23.843164 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-61de829d-2991-47c5-8aa0-951fc9783866 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:23.844291 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-61de829d-2991-47c5-8aa0-951fc9783866 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:23.852072 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-466d588d-450c-4bd7-a8df-72a4e2e2bd81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for project d19c107f773440eb8c2ab26706bc3591. Resources: {'key_pairs'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:27:23.855893 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-466d588d-450c-4bd7-a8df-72a4e2e2bd81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for user 4775744e6880427c8e91e67afe713052 and project d19c107f773440eb8c2ab26706bc3591. Resources: {'key_pairs'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:27:23.961714 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-61de829d-2991-47c5-8aa0-951fc9783866 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:23.969550 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-61de829d-2991-47c5-8aa0-951fc9783866 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:23.971032 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-61de829d-2991-47c5-8aa0-951fc9783866 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:23.972172 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-61de829d-2991-47c5-8aa0-951fc9783866 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1716 microversion: 2.20 time: 0.142621 Aug 19 09:27:23.972710 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 602/1228] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:27:23 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1716 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:27:24.043933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-466d588d-450c-4bd7-a8df-72a4e2e2bd81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for project d19c107f773440eb8c2ab26706bc3591. Resources: {'key_pairs'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:27:24.048001 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-466d588d-450c-4bd7-a8df-72a4e2e2bd81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for user 4775744e6880427c8e91e67afe713052 and project d19c107f773440eb8c2ab26706bc3591. Resources: {'key_pairs'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:27:24.060582 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-466d588d-450c-4bd7-a8df-72a4e2e2bd81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.231155 Aug 19 09:27:24.061169 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 627/1229] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Aug 19 09:27:23 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:24.714650 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-04dbabe8-07aa-4bbd-812a-f35604587d96 req-d5a07ca7-1eaa-48a1-900c-b649e456adc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89098f09-c8cd-4e15-bef5-1bc104634225", "name": "network-vif-plugged", "status": "completed", "tag": "c72c5439-5706-4605-91f9-225118f3705b"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:24.716315 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:27:24.716315 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:27:24.724543 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-04dbabe8-07aa-4bbd-812a-f35604587d96 req-d5a07ca7-1eaa-48a1-900c-b649e456adc6 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:24.725176 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-04dbabe8-07aa-4bbd-812a-f35604587d96 req-d5a07ca7-1eaa-48a1-900c-b649e456adc6 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:24.737052 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-04dbabe8-07aa-4bbd-812a-f35604587d96 req-d5a07ca7-1eaa-48a1-900c-b649e456adc6 service nova] Creating event network-vif-plugged:c72c5439-5706-4605-91f9-225118f3705b for instance 89098f09-c8cd-4e15-bef5-1bc104634225 on hv-cinder-77387 Aug 19 09:27:24.742252 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-04dbabe8-07aa-4bbd-812a-f35604587d96 req-d5a07ca7-1eaa-48a1-900c-b649e456adc6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031390 Aug 19 09:27:24.742995 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 603/1230] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:27:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:27:25.266316 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1127539417", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af454d54-e9ac-4c38-8d56-87a8a6413746"}], "security_groups": [{"name": "tempest-securitygroup--1611651219"}], "key_name": "tempest-keypair-1754181333", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:25.366445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.network.neutron [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] validate_networks() for [('af454d54-e9ac-4c38-8d56-87a8a6413746', None, None, None, None, None)] {{(pid=107957) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:27:25.785107 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Flavor limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:27:25.785526 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Image limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:27:25.785990 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Flavor pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:27:25.786393 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Image pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:27:25.786799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:27:25.795081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:25.795547 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:25.796331 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:25.797805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:25.814122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for project d19c107f773440eb8c2ab26706bc3591. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:27:25.817888 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Getting quotas for user 4775744e6880427c8e91e67afe713052 and project d19c107f773440eb8c2ab26706bc3591. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:27:25.828997 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Going to run 1 instances... {{(pid=107957) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:27:25.831233 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:27:25.877455 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b5e41269-b2ae-423f-9684-0eaa3d65a0f2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.616214 Aug 19 09:27:25.878091 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 628/1231] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:27:25 2021] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:27:25.888295 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d007137e-204d-4c96-8602-4fe1698c6411 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:25.888982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d007137e-204d-4c96-8602-4fe1698c6411 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:25.946984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d007137e-204d-4c96-8602-4fe1698c6411 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:25.954230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d007137e-204d-4c96-8602-4fe1698c6411 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1238 microversion: 2.1 time: 0.069860 Aug 19 09:27:25.954809 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 604/1232] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:25 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:26.971074 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6aa0a888-e948-4f7c-919a-5ac7fb630689 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:26.971714 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6aa0a888-e948-4f7c-919a-5ac7fb630689 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:27.024446 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6aa0a888-e948-4f7c-919a-5ac7fb630689 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:27.031178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6aa0a888-e948-4f7c-919a-5ac7fb630689 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1238 microversion: 2.1 time: 0.063920 Aug 19 09:27:27.031877 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 629/1233] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:26 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:28.048456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7657e904-36fe-48f0-a338-38d88f8776f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:28.048995 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7657e904-36fe-48f0-a338-38d88f8776f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:28.054900 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7657e904-36fe-48f0-a338-38d88f8776f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:28.055387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7657e904-36fe-48f0-a338-38d88f8776f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:28.056155 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7657e904-36fe-48f0-a338-38d88f8776f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:28.056673 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7657e904-36fe-48f0-a338-38d88f8776f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:28.125728 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7657e904-36fe-48f0-a338-38d88f8776f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:28.133004 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7657e904-36fe-48f0-a338-38d88f8776f0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1296 microversion: 2.1 time: 0.088903 Aug 19 09:27:28.133561 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 605/1234] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:28 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:29.037872 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-906dd3c9-17be-479d-a52f-1559f156afea req-77ce8050-72cc-4aa7-a0a6-129f415326d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402d3979-28e9-446f-b50d-c5f17f340a4c", "tag": "ba0255ca-86c6-4ef3-a366-9048b06a1e36"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:29.040018 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:27:29.040018 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:27:29.052114 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-906dd3c9-17be-479d-a52f-1559f156afea req-77ce8050-72cc-4aa7-a0a6-129f415326d3 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:29.052601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-906dd3c9-17be-479d-a52f-1559f156afea req-77ce8050-72cc-4aa7-a0a6-129f415326d3 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:29.068217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-906dd3c9-17be-479d-a52f-1559f156afea req-77ce8050-72cc-4aa7-a0a6-129f415326d3 service nova] Creating event network-changed:ba0255ca-86c6-4ef3-a366-9048b06a1e36 for instance 402d3979-28e9-446f-b50d-c5f17f340a4c on hv-cinder-77387 Aug 19 09:27:29.073257 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-906dd3c9-17be-479d-a52f-1559f156afea req-77ce8050-72cc-4aa7-a0a6-129f415326d3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039191 Aug 19 09:27:29.074075 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 630/1235] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:27:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:27:29.149740 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3a472db9-ee83-4954-9086-8c1249b42261 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:29.150357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3a472db9-ee83-4954-9086-8c1249b42261 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:29.156728 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3a472db9-ee83-4954-9086-8c1249b42261 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:29.157241 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3a472db9-ee83-4954-9086-8c1249b42261 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:29.158029 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3a472db9-ee83-4954-9086-8c1249b42261 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:29.158465 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3a472db9-ee83-4954-9086-8c1249b42261 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:29.347435 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3a472db9-ee83-4954-9086-8c1249b42261 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:29.354801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3a472db9-ee83-4954-9086-8c1249b42261 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1364 microversion: 2.1 time: 0.208700 Aug 19 09:27:29.355615 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 606/1236] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:29 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:30.372301 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4ccc5ef5-aade-4ba5-b8e0-36360d46d7b7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:30.372995 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4ccc5ef5-aade-4ba5-b8e0-36360d46d7b7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:30.379680 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4ccc5ef5-aade-4ba5-b8e0-36360d46d7b7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:30.380126 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4ccc5ef5-aade-4ba5-b8e0-36360d46d7b7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:30.380888 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4ccc5ef5-aade-4ba5-b8e0-36360d46d7b7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:30.381328 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4ccc5ef5-aade-4ba5-b8e0-36360d46d7b7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:30.500438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4ccc5ef5-aade-4ba5-b8e0-36360d46d7b7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:30.507545 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4ccc5ef5-aade-4ba5-b8e0-36360d46d7b7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1364 microversion: 2.1 time: 0.139272 Aug 19 09:27:30.508096 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 631/1237] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:30 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1364 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:31.524571 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2a99158d-8c38-480e-8f6a-c3d271c9490e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:31.525180 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2a99158d-8c38-480e-8f6a-c3d271c9490e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:31.531708 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2a99158d-8c38-480e-8f6a-c3d271c9490e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:31.532184 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2a99158d-8c38-480e-8f6a-c3d271c9490e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:31.532943 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2a99158d-8c38-480e-8f6a-c3d271c9490e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:31.533380 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2a99158d-8c38-480e-8f6a-c3d271c9490e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:31.650228 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2a99158d-8c38-480e-8f6a-c3d271c9490e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:31.657500 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2a99158d-8c38-480e-8f6a-c3d271c9490e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1364 microversion: 2.1 time: 0.136581 Aug 19 09:27:31.658062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 607/1238] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:31 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1364 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:32.674526 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-55b6d2be-6b62-43b1-92b3-b6b3e0af33e4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:32.675250 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-55b6d2be-6b62-43b1-92b3-b6b3e0af33e4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:32.681125 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-55b6d2be-6b62-43b1-92b3-b6b3e0af33e4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:32.681574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-55b6d2be-6b62-43b1-92b3-b6b3e0af33e4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:32.682329 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-55b6d2be-6b62-43b1-92b3-b6b3e0af33e4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:32.682757 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-55b6d2be-6b62-43b1-92b3-b6b3e0af33e4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:32.806431 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-55b6d2be-6b62-43b1-92b3-b6b3e0af33e4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:32.814399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-55b6d2be-6b62-43b1-92b3-b6b3e0af33e4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1364 microversion: 2.1 time: 0.143870 Aug 19 09:27:32.814714 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 632/1239] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:32 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:33.830579 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3cd1df4c-68fe-4745-9547-b6e930224c63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:33.831101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3cd1df4c-68fe-4745-9547-b6e930224c63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:33.836964 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cd1df4c-68fe-4745-9547-b6e930224c63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:33.837411 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cd1df4c-68fe-4745-9547-b6e930224c63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:33.838175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cd1df4c-68fe-4745-9547-b6e930224c63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:33.838609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3cd1df4c-68fe-4745-9547-b6e930224c63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:33.954237 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3cd1df4c-68fe-4745-9547-b6e930224c63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:33.961284 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3cd1df4c-68fe-4745-9547-b6e930224c63 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1364 microversion: 2.1 time: 0.134422 Aug 19 09:27:33.961835 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 608/1240] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:33 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1364 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:34.778587 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-c3dcf968-43a0-496e-841b-a456e9ed9c21 req-9155f274-9b16-40ae-aab5-5ebd82ba51a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "402d3979-28e9-446f-b50d-c5f17f340a4c", "name": "network-vif-plugged", "status": "completed", "tag": "ba0255ca-86c6-4ef3-a366-9048b06a1e36"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:34.780139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:27:34.780139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:27:34.787254 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-c3dcf968-43a0-496e-841b-a456e9ed9c21 req-9155f274-9b16-40ae-aab5-5ebd82ba51a0 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:34.787736 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-c3dcf968-43a0-496e-841b-a456e9ed9c21 req-9155f274-9b16-40ae-aab5-5ebd82ba51a0 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:34.801286 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-c3dcf968-43a0-496e-841b-a456e9ed9c21 req-9155f274-9b16-40ae-aab5-5ebd82ba51a0 service nova] Creating event network-vif-plugged:ba0255ca-86c6-4ef3-a366-9048b06a1e36 for instance 402d3979-28e9-446f-b50d-c5f17f340a4c on hv-cinder-77387 Aug 19 09:27:34.806103 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-c3dcf968-43a0-496e-841b-a456e9ed9c21 req-9155f274-9b16-40ae-aab5-5ebd82ba51a0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031150 Aug 19 09:27:34.806759 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 633/1241] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:27:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:27:34.978062 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-22bf807b-6088-4db3-919c-26bcf545decf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:34.978598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-22bf807b-6088-4db3-919c-26bcf545decf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:34.984238 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22bf807b-6088-4db3-919c-26bcf545decf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:34.984679 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22bf807b-6088-4db3-919c-26bcf545decf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:34.985526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22bf807b-6088-4db3-919c-26bcf545decf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:34.985866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-22bf807b-6088-4db3-919c-26bcf545decf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:35.130730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-22bf807b-6088-4db3-919c-26bcf545decf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:35.137726 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-22bf807b-6088-4db3-919c-26bcf545decf tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1364 microversion: 2.1 time: 0.163398 Aug 19 09:27:35.138277 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 609/1242] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:34 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:36.155077 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-992db3e5-3a36-4ae1-b0e2-5ecf13e12724 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:36.155784 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-992db3e5-3a36-4ae1-b0e2-5ecf13e12724 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:36.162575 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-992db3e5-3a36-4ae1-b0e2-5ecf13e12724 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:36.163012 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-992db3e5-3a36-4ae1-b0e2-5ecf13e12724 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:36.163789 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-992db3e5-3a36-4ae1-b0e2-5ecf13e12724 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:36.164217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-992db3e5-3a36-4ae1-b0e2-5ecf13e12724 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:36.290575 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-992db3e5-3a36-4ae1-b0e2-5ecf13e12724 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:36.297570 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-992db3e5-3a36-4ae1-b0e2-5ecf13e12724 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1364 microversion: 2.1 time: 0.146438 Aug 19 09:27:36.298114 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 634/1243] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:36 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:37.313643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1b68b86b-ad3a-4e70-aad2-f2fa42c2041d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:37.314244 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1b68b86b-ad3a-4e70-aad2-f2fa42c2041d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:37.320149 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1b68b86b-ad3a-4e70-aad2-f2fa42c2041d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:37.320601 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1b68b86b-ad3a-4e70-aad2-f2fa42c2041d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:37.321364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1b68b86b-ad3a-4e70-aad2-f2fa42c2041d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:37.321823 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1b68b86b-ad3a-4e70-aad2-f2fa42c2041d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:37.439607 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1b68b86b-ad3a-4e70-aad2-f2fa42c2041d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:27:37.446689 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1b68b86b-ad3a-4e70-aad2-f2fa42c2041d tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1550 microversion: 2.1 time: 0.136681 Aug 19 09:27:37.447250 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 610/1244] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:27:37 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1550 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:37.462963 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1dd2b7e0-3afd-4573-81e5-f16b85ad20a1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:27:37.463496 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1dd2b7e0-3afd-4573-81e5-f16b85ad20a1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:37.469784 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1dd2b7e0-3afd-4573-81e5-f16b85ad20a1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:37.470405 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1dd2b7e0-3afd-4573-81e5-f16b85ad20a1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:37.471203 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1dd2b7e0-3afd-4573-81e5-f16b85ad20a1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:37.471679 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1dd2b7e0-3afd-4573-81e5-f16b85ad20a1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:37.550159 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1dd2b7e0-3afd-4573-81e5-f16b85ad20a1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090745 Aug 19 09:27:37.551018 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 635/1245] 10.222.0.32 () {58 vars in 1275 bytes} [Thu Aug 19 09:27:37 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:27:38.475564 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-acea5e20-31b1-4b91-84e8-6bb4c71b813c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:38.476681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-acea5e20-31b1-4b91-84e8-6bb4c71b813c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:38.484389 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-acea5e20-31b1-4b91-84e8-6bb4c71b813c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:38.485516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-acea5e20-31b1-4b91-84e8-6bb4c71b813c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:38.486447 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-acea5e20-31b1-4b91-84e8-6bb4c71b813c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:38.486891 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-acea5e20-31b1-4b91-84e8-6bb4c71b813c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:38.538448 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-15d154de-0fdb-4b5f-ac59-e93ee587fc80 req-ed33fb85-f128-46e0-a50d-a1336323ad5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402d3979-28e9-446f-b50d-c5f17f340a4c", "tag": "ba0255ca-86c6-4ef3-a366-9048b06a1e36"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:38.540026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:27:38.540026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:27:38.547207 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-15d154de-0fdb-4b5f-ac59-e93ee587fc80 req-ed33fb85-f128-46e0-a50d-a1336323ad5b service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:38.548354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-15d154de-0fdb-4b5f-ac59-e93ee587fc80 req-ed33fb85-f128-46e0-a50d-a1336323ad5b service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:38.560032 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-15d154de-0fdb-4b5f-ac59-e93ee587fc80 req-ed33fb85-f128-46e0-a50d-a1336323ad5b service nova] Creating event network-changed:ba0255ca-86c6-4ef3-a366-9048b06a1e36 for instance 402d3979-28e9-446f-b50d-c5f17f340a4c on hv-cinder-77387 Aug 19 09:27:38.565051 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-15d154de-0fdb-4b5f-ac59-e93ee587fc80 req-ed33fb85-f128-46e0-a50d-a1336323ad5b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090260 Aug 19 09:27:38.565647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 636/1246] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:27:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:27:38.577707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-acea5e20-31b1-4b91-84e8-6bb4c71b813c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 14 microversion: 2.1 time: 0.105855 Aug 19 09:27:38.578687 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 611/1247] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:38 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:39.589250 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-98507fe1-53e7-4696-b3d7-b77400ffc365 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:39.590239 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-98507fe1-53e7-4696-b3d7-b77400ffc365 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:39.596867 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98507fe1-53e7-4696-b3d7-b77400ffc365 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:39.597310 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98507fe1-53e7-4696-b3d7-b77400ffc365 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:39.598339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98507fe1-53e7-4696-b3d7-b77400ffc365 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:39.598766 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-98507fe1-53e7-4696-b3d7-b77400ffc365 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:39.679416 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-98507fe1-53e7-4696-b3d7-b77400ffc365 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 14 microversion: 2.1 time: 0.093782 Aug 19 09:27:39.680224 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 637/1248] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:39 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:40.690291 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-74c4422c-d017-4057-ad72-7cb729b1fa6b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:40.691230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-74c4422c-d017-4057-ad72-7cb729b1fa6b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:40.697628 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74c4422c-d017-4057-ad72-7cb729b1fa6b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:40.698071 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74c4422c-d017-4057-ad72-7cb729b1fa6b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:40.698859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74c4422c-d017-4057-ad72-7cb729b1fa6b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:40.699308 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-74c4422c-d017-4057-ad72-7cb729b1fa6b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:40.788244 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-74c4422c-d017-4057-ad72-7cb729b1fa6b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 14 microversion: 2.1 time: 0.102548 Aug 19 09:27:40.788831 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 612/1249] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:40 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:41.800244 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-57e4471e-5ab9-4fe8-b41f-e25251a4633f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:41.801158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-57e4471e-5ab9-4fe8-b41f-e25251a4633f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:41.807502 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-57e4471e-5ab9-4fe8-b41f-e25251a4633f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:41.807944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-57e4471e-5ab9-4fe8-b41f-e25251a4633f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:41.808695 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-57e4471e-5ab9-4fe8-b41f-e25251a4633f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:41.809122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-57e4471e-5ab9-4fe8-b41f-e25251a4633f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:41.908163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-57e4471e-5ab9-4fe8-b41f-e25251a4633f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 14 microversion: 2.1 time: 0.112680 Aug 19 09:27:41.908968 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 638/1250] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:41 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:42.920536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7a7310e7-0544-46c4-8df2-2a6c7d3f15f6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:42.921558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7a7310e7-0544-46c4-8df2-2a6c7d3f15f6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:42.928312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7a7310e7-0544-46c4-8df2-2a6c7d3f15f6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:42.928755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7a7310e7-0544-46c4-8df2-2a6c7d3f15f6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:42.929524 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7a7310e7-0544-46c4-8df2-2a6c7d3f15f6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:42.929961 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7a7310e7-0544-46c4-8df2-2a6c7d3f15f6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:43.011643 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7a7310e7-0544-46c4-8df2-2a6c7d3f15f6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 14 microversion: 2.1 time: 0.095650 Aug 19 09:27:43.012313 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 613/1251] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:42 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:44.023122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5c14f474-0f13-49ef-8466-c4175a15050b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:44.024132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5c14f474-0f13-49ef-8466-c4175a15050b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:44.030662 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c14f474-0f13-49ef-8466-c4175a15050b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:44.031107 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c14f474-0f13-49ef-8466-c4175a15050b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:44.032447 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c14f474-0f13-49ef-8466-c4175a15050b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:44.032903 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5c14f474-0f13-49ef-8466-c4175a15050b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:44.116976 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5c14f474-0f13-49ef-8466-c4175a15050b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 14 microversion: 2.1 time: 0.097771 Aug 19 09:27:44.117594 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 639/1252] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:44 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:45.129232 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-841561f3-90be-458f-b417-a870260f28fb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:45.130218 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-841561f3-90be-458f-b417-a870260f28fb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:45.136571 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-841561f3-90be-458f-b417-a870260f28fb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:45.137016 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-841561f3-90be-458f-b417-a870260f28fb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:45.137774 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-841561f3-90be-458f-b417-a870260f28fb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:45.138206 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-841561f3-90be-458f-b417-a870260f28fb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:45.214587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-841561f3-90be-458f-b417-a870260f28fb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 14 microversion: 2.1 time: 0.089794 Aug 19 09:27:45.215218 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 614/1253] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:45 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:46.225819 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cb8b9411-ac4a-4c2e-8270-fa15d3874a75 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:46.226829 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cb8b9411-ac4a-4c2e-8270-fa15d3874a75 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:46.233197 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb8b9411-ac4a-4c2e-8270-fa15d3874a75 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:46.233643 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb8b9411-ac4a-4c2e-8270-fa15d3874a75 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:46.234405 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb8b9411-ac4a-4c2e-8270-fa15d3874a75 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:46.234821 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cb8b9411-ac4a-4c2e-8270-fa15d3874a75 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:46.331803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cb8b9411-ac4a-4c2e-8270-fa15d3874a75 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 14 microversion: 2.1 time: 0.110058 Aug 19 09:27:46.332438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 640/1254] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:46 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:47.342367 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6dd935f7-02da-4518-bfcd-3c0dccb7b15a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:47.343392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6dd935f7-02da-4518-bfcd-3c0dccb7b15a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:47.350625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6dd935f7-02da-4518-bfcd-3c0dccb7b15a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:47.351066 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6dd935f7-02da-4518-bfcd-3c0dccb7b15a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:47.351848 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6dd935f7-02da-4518-bfcd-3c0dccb7b15a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:47.352272 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6dd935f7-02da-4518-bfcd-3c0dccb7b15a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:47.431363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6dd935f7-02da-4518-bfcd-3c0dccb7b15a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 14 microversion: 2.1 time: 0.092808 Aug 19 09:27:47.431970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 615/1255] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:47 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:48.442563 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a629b684-9d45-48ee-896a-1309a48bf3dc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:48.443639 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a629b684-9d45-48ee-896a-1309a48bf3dc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:48.450043 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a629b684-9d45-48ee-896a-1309a48bf3dc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:48.450488 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a629b684-9d45-48ee-896a-1309a48bf3dc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:48.451246 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a629b684-9d45-48ee-896a-1309a48bf3dc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:48.451695 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a629b684-9d45-48ee-896a-1309a48bf3dc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:48.538782 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a629b684-9d45-48ee-896a-1309a48bf3dc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 14 microversion: 2.1 time: 0.100241 Aug 19 09:27:48.539441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 641/1256] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:48 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:27:49.549810 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6bfaf51d-7c62-485d-9ba4-f3ccd3f5e9f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:49.550805 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6bfaf51d-7c62-485d-9ba4-f3ccd3f5e9f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:49.557202 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6bfaf51d-7c62-485d-9ba4-f3ccd3f5e9f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:49.557649 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6bfaf51d-7c62-485d-9ba4-f3ccd3f5e9f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:49.558407 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6bfaf51d-7c62-485d-9ba4-f3ccd3f5e9f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:49.558838 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6bfaf51d-7c62-485d-9ba4-f3ccd3f5e9f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:49.655981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6bfaf51d-7c62-485d-9ba4-f3ccd3f5e9f8 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 9954 microversion: 2.1 time: 0.110106 Aug 19 09:27:49.657220 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 616/1257] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:49 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 9954 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:27:50.668480 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-82603513-59c9-40eb-b046-5c2eb8872731 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:50.669393 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-82603513-59c9-40eb-b046-5c2eb8872731 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:50.676797 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-82603513-59c9-40eb-b046-5c2eb8872731 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:50.677244 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-82603513-59c9-40eb-b046-5c2eb8872731 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:50.678008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-82603513-59c9-40eb-b046-5c2eb8872731 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:50.678437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-82603513-59c9-40eb-b046-5c2eb8872731 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:50.766504 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-82603513-59c9-40eb-b046-5c2eb8872731 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 17602 microversion: 2.1 time: 0.101834 Aug 19 09:27:50.767314 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 642/1258] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:50 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 17602 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:27:51.778313 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a8f40d09-d96c-4097-abd9-42fdaa2c8d2e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:51.779229 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a8f40d09-d96c-4097-abd9-42fdaa2c8d2e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:51.785647 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a8f40d09-d96c-4097-abd9-42fdaa2c8d2e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:51.786092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a8f40d09-d96c-4097-abd9-42fdaa2c8d2e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:51.786848 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a8f40d09-d96c-4097-abd9-42fdaa2c8d2e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:51.787287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a8f40d09-d96c-4097-abd9-42fdaa2c8d2e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:51.873982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a8f40d09-d96c-4097-abd9-42fdaa2c8d2e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 18961 microversion: 2.1 time: 0.099641 Aug 19 09:27:51.874602 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 617/1259] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:51 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 18961 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:27:52.886462 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-75ba15b8-6e14-4d30-9819-fac9651e4e51 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:52.887487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-75ba15b8-6e14-4d30-9819-fac9651e4e51 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:52.894869 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75ba15b8-6e14-4d30-9819-fac9651e4e51 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:52.895351 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75ba15b8-6e14-4d30-9819-fac9651e4e51 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:52.896118 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75ba15b8-6e14-4d30-9819-fac9651e4e51 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:52.896547 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75ba15b8-6e14-4d30-9819-fac9651e4e51 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:52.985813 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-75ba15b8-6e14-4d30-9819-fac9651e4e51 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 21513 microversion: 2.1 time: 0.103276 Aug 19 09:27:52.986629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 643/1260] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:52 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 21513 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:27:53.997567 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a7dbc7ba-a484-4cc1-b500-9f27e60892af tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:53.998553 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a7dbc7ba-a484-4cc1-b500-9f27e60892af tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:54.005070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a7dbc7ba-a484-4cc1-b500-9f27e60892af tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:54.005510 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a7dbc7ba-a484-4cc1-b500-9f27e60892af tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:54.006259 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a7dbc7ba-a484-4cc1-b500-9f27e60892af tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:54.006685 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a7dbc7ba-a484-4cc1-b500-9f27e60892af tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:54.097107 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a7dbc7ba-a484-4cc1-b500-9f27e60892af tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 23222 microversion: 2.1 time: 0.103378 Aug 19 09:27:54.097713 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 618/1261] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:53 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 23222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:27:55.109424 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-72003512-387f-4697-b6b1-50e10c52f964 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:55.111117 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-72003512-387f-4697-b6b1-50e10c52f964 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:55.117540 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-72003512-387f-4697-b6b1-50e10c52f964 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:55.117996 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-72003512-387f-4697-b6b1-50e10c52f964 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:55.118761 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-72003512-387f-4697-b6b1-50e10c52f964 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:55.119207 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-72003512-387f-4697-b6b1-50e10c52f964 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:55.206812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-72003512-387f-4697-b6b1-50e10c52f964 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 24554 microversion: 2.1 time: 0.101248 Aug 19 09:27:55.207440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 644/1262] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:55 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 24554 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:27:56.218562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4c95deba-8730-4ffd-93fa-155085b79fec tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:56.219691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4c95deba-8730-4ffd-93fa-155085b79fec tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:56.226418 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4c95deba-8730-4ffd-93fa-155085b79fec tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:56.226866 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4c95deba-8730-4ffd-93fa-155085b79fec tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:56.227653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4c95deba-8730-4ffd-93fa-155085b79fec tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:56.228086 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4c95deba-8730-4ffd-93fa-155085b79fec tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:56.333315 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4c95deba-8730-4ffd-93fa-155085b79fec tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 26205 microversion: 2.1 time: 0.118590 Aug 19 09:27:56.333918 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 619/1263] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:56 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 26205 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:27:57.345705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5dbf558b-f88f-4a19-a523-b92c1a233a0a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:57.346693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5dbf558b-f88f-4a19-a523-b92c1a233a0a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:57.353431 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5dbf558b-f88f-4a19-a523-b92c1a233a0a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:57.353870 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5dbf558b-f88f-4a19-a523-b92c1a233a0a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:57.354626 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5dbf558b-f88f-4a19-a523-b92c1a233a0a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:57.355051 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5dbf558b-f88f-4a19-a523-b92c1a233a0a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:57.448562 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5dbf558b-f88f-4a19-a523-b92c1a233a0a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 27526 microversion: 2.1 time: 0.107256 Aug 19 09:27:57.449190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 645/1264] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:57 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 27526 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:27:58.461031 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7aa3d9fd-5999-43e2-9868-c9f411ce98c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:58.462017 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7aa3d9fd-5999-43e2-9868-c9f411ce98c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:58.468413 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7aa3d9fd-5999-43e2-9868-c9f411ce98c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:58.469461 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7aa3d9fd-5999-43e2-9868-c9f411ce98c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:58.470321 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7aa3d9fd-5999-43e2-9868-c9f411ce98c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:58.470755 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7aa3d9fd-5999-43e2-9868-c9f411ce98c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:58.558202 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7aa3d9fd-5999-43e2-9868-c9f411ce98c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 27957 microversion: 2.1 time: 0.101060 Aug 19 09:27:58.558809 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 620/1265] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:58 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 27957 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:27:59.570021 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-44bc67f1-6627-4abb-a500-e7a32a3eeef7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:27:59.571026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-44bc67f1-6627-4abb-a500-e7a32a3eeef7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:27:59.577396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44bc67f1-6627-4abb-a500-e7a32a3eeef7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:59.577836 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44bc67f1-6627-4abb-a500-e7a32a3eeef7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:59.578608 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44bc67f1-6627-4abb-a500-e7a32a3eeef7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:27:59.579033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44bc67f1-6627-4abb-a500-e7a32a3eeef7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:27:59.676359 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-44bc67f1-6627-4abb-a500-e7a32a3eeef7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.110154 Aug 19 09:27:59.676885 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 646/1266] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:27:59 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:00.687742 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9eeafbcd-b917-4a89-b76d-c8b5da11e926 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:00.688641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9eeafbcd-b917-4a89-b76d-c8b5da11e926 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:00.696378 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9eeafbcd-b917-4a89-b76d-c8b5da11e926 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:00.696819 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9eeafbcd-b917-4a89-b76d-c8b5da11e926 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:00.697565 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9eeafbcd-b917-4a89-b76d-c8b5da11e926 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:00.697992 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9eeafbcd-b917-4a89-b76d-c8b5da11e926 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:00.778605 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9eeafbcd-b917-4a89-b76d-c8b5da11e926 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.095011 Aug 19 09:28:00.779201 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 621/1267] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:00 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:01.791326 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1a8038e7-9876-4072-8a36-45c3ba7f9bb9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:01.792243 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1a8038e7-9876-4072-8a36-45c3ba7f9bb9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:01.799818 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1a8038e7-9876-4072-8a36-45c3ba7f9bb9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:01.800269 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1a8038e7-9876-4072-8a36-45c3ba7f9bb9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:01.801035 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1a8038e7-9876-4072-8a36-45c3ba7f9bb9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:01.801467 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1a8038e7-9876-4072-8a36-45c3ba7f9bb9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:01.881791 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1a8038e7-9876-4072-8a36-45c3ba7f9bb9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.094428 Aug 19 09:28:01.882696 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 647/1268] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:01 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:02.894019 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8de5b3b8-cdf9-49dc-b4f2-a61b55b054c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:02.895033 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8de5b3b8-cdf9-49dc-b4f2-a61b55b054c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:02.901440 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8de5b3b8-cdf9-49dc-b4f2-a61b55b054c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:02.901884 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8de5b3b8-cdf9-49dc-b4f2-a61b55b054c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:02.902634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8de5b3b8-cdf9-49dc-b4f2-a61b55b054c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:02.903058 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8de5b3b8-cdf9-49dc-b4f2-a61b55b054c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:02.982352 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8de5b3b8-cdf9-49dc-b4f2-a61b55b054c3 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.092863 Aug 19 09:28:02.982956 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 622/1269] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:02 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:03.994131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-bb386f94-68af-4557-9c84-4fd311dc6af2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:03.995116 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-bb386f94-68af-4557-9c84-4fd311dc6af2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:04.001686 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb386f94-68af-4557-9c84-4fd311dc6af2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:04.002124 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb386f94-68af-4557-9c84-4fd311dc6af2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:04.002875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb386f94-68af-4557-9c84-4fd311dc6af2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:04.003324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb386f94-68af-4557-9c84-4fd311dc6af2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:04.084597 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-bb386f94-68af-4557-9c84-4fd311dc6af2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.094295 Aug 19 09:28:04.085242 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 648/1270] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:03 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:05.095614 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6f42994e-2a50-4285-9564-257544494de2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:05.096594 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6f42994e-2a50-4285-9564-257544494de2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:05.103184 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f42994e-2a50-4285-9564-257544494de2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:05.103653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f42994e-2a50-4285-9564-257544494de2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:05.104405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f42994e-2a50-4285-9564-257544494de2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:05.104836 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f42994e-2a50-4285-9564-257544494de2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:05.186106 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6f42994e-2a50-4285-9564-257544494de2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.094368 Aug 19 09:28:05.186709 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 623/1271] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:05 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:06.198783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ac233e18-9566-4855-8fe1-1af8f0309d2b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:06.199794 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ac233e18-9566-4855-8fe1-1af8f0309d2b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:06.207162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ac233e18-9566-4855-8fe1-1af8f0309d2b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:06.207624 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ac233e18-9566-4855-8fe1-1af8f0309d2b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:06.208531 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ac233e18-9566-4855-8fe1-1af8f0309d2b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:06.208962 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ac233e18-9566-4855-8fe1-1af8f0309d2b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:06.295081 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ac233e18-9566-4855-8fe1-1af8f0309d2b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.100209 Aug 19 09:28:06.296243 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 649/1272] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:06 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:07.307620 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-37496150-a33f-48f7-983d-ecebc408de3c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:07.308527 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-37496150-a33f-48f7-983d-ecebc408de3c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:07.314953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-37496150-a33f-48f7-983d-ecebc408de3c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:07.315497 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-37496150-a33f-48f7-983d-ecebc408de3c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:07.316259 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-37496150-a33f-48f7-983d-ecebc408de3c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:07.316691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-37496150-a33f-48f7-983d-ecebc408de3c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:07.396693 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-37496150-a33f-48f7-983d-ecebc408de3c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.093001 Aug 19 09:28:07.397326 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 624/1273] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:07 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:08.409439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-bb3e3c2d-f0b9-40ef-b15b-bc8fe3fe3176 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:08.410419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-bb3e3c2d-f0b9-40ef-b15b-bc8fe3fe3176 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:08.416403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb3e3c2d-f0b9-40ef-b15b-bc8fe3fe3176 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:08.416845 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb3e3c2d-f0b9-40ef-b15b-bc8fe3fe3176 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:08.417599 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb3e3c2d-f0b9-40ef-b15b-bc8fe3fe3176 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:08.418027 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bb3e3c2d-f0b9-40ef-b15b-bc8fe3fe3176 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:08.499916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-bb3e3c2d-f0b9-40ef-b15b-bc8fe3fe3176 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.095652 Aug 19 09:28:08.500702 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 650/1274] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:08 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:09.512303 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f187934c-9751-4b76-b61f-331a7c936971 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:09.513291 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f187934c-9751-4b76-b61f-331a7c936971 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:09.519997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f187934c-9751-4b76-b61f-331a7c936971 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:09.520446 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f187934c-9751-4b76-b61f-331a7c936971 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:09.521203 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f187934c-9751-4b76-b61f-331a7c936971 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:09.521631 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f187934c-9751-4b76-b61f-331a7c936971 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:09.604850 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f187934c-9751-4b76-b61f-331a7c936971 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.096409 Aug 19 09:28:09.605469 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 625/1275] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:09 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:10.617335 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-258931c2-73c4-439c-ae97-a604e54f539e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:10.618347 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-258931c2-73c4-439c-ae97-a604e54f539e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:10.624683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-258931c2-73c4-439c-ae97-a604e54f539e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:10.625122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-258931c2-73c4-439c-ae97-a604e54f539e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:10.626477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-258931c2-73c4-439c-ae97-a604e54f539e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:10.626902 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-258931c2-73c4-439c-ae97-a604e54f539e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:10.707440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-258931c2-73c4-439c-ae97-a604e54f539e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.093897 Aug 19 09:28:10.707977 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 651/1276] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:10 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:11.719530 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a3c32256-749d-4aeb-90d2-d6f9bf52204a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:11.720428 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-a3c32256-749d-4aeb-90d2-d6f9bf52204a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:11.727054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a3c32256-749d-4aeb-90d2-d6f9bf52204a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:11.727531 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a3c32256-749d-4aeb-90d2-d6f9bf52204a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:11.728295 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a3c32256-749d-4aeb-90d2-d6f9bf52204a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:11.728729 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-a3c32256-749d-4aeb-90d2-d6f9bf52204a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:11.814224 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a3c32256-749d-4aeb-90d2-d6f9bf52204a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28255 microversion: 2.1 time: 0.097790 Aug 19 09:28:11.814838 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 626/1277] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:11 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28255 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:12.825389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4a186ca0-efb3-4f9b-8230-0906012f42ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:12.826345 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4a186ca0-efb3-4f9b-8230-0906012f42ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:12.832906 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4a186ca0-efb3-4f9b-8230-0906012f42ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:12.833350 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4a186ca0-efb3-4f9b-8230-0906012f42ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:12.834111 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4a186ca0-efb3-4f9b-8230-0906012f42ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:12.834543 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4a186ca0-efb3-4f9b-8230-0906012f42ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:12.924457 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4a186ca0-efb3-4f9b-8230-0906012f42ab tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28546 microversion: 2.1 time: 0.103132 Aug 19 09:28:12.925060 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 652/1278] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:12 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28546 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:13.936556 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-41e4cce3-05f5-4b6a-8a0d-c7ece184cceb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:13.937578 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-41e4cce3-05f5-4b6a-8a0d-c7ece184cceb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:13.944613 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-41e4cce3-05f5-4b6a-8a0d-c7ece184cceb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:13.945058 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-41e4cce3-05f5-4b6a-8a0d-c7ece184cceb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:13.945818 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-41e4cce3-05f5-4b6a-8a0d-c7ece184cceb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:13.946254 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-41e4cce3-05f5-4b6a-8a0d-c7ece184cceb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:14.028125 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-41e4cce3-05f5-4b6a-8a0d-c7ece184cceb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28546 microversion: 2.1 time: 0.095465 Aug 19 09:28:14.028742 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 627/1279] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:13 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28546 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:15.040983 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-27714809-20ad-4448-b26c-c684c49bdbcb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:15.041977 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-27714809-20ad-4448-b26c-c684c49bdbcb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:15.048885 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27714809-20ad-4448-b26c-c684c49bdbcb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:15.049327 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27714809-20ad-4448-b26c-c684c49bdbcb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:15.050088 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27714809-20ad-4448-b26c-c684c49bdbcb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:15.050518 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-27714809-20ad-4448-b26c-c684c49bdbcb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:15.150292 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-27714809-20ad-4448-b26c-c684c49bdbcb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.113166 Aug 19 09:28:15.150916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 653/1280] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:15 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:16.162294 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3d4bf704-c0f0-49da-859a-fb7c88e8111a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:16.163436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3d4bf704-c0f0-49da-859a-fb7c88e8111a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:16.169925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3d4bf704-c0f0-49da-859a-fb7c88e8111a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:16.170374 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3d4bf704-c0f0-49da-859a-fb7c88e8111a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:16.171140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3d4bf704-c0f0-49da-859a-fb7c88e8111a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:16.171613 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3d4bf704-c0f0-49da-859a-fb7c88e8111a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:16.256152 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3d4bf704-c0f0-49da-859a-fb7c88e8111a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.097682 Aug 19 09:28:16.257055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 628/1281] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:16 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:17.268801 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-23fc29aa-1e8b-4b6e-a621-35588cda232a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:17.269792 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-23fc29aa-1e8b-4b6e-a621-35588cda232a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:17.276131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-23fc29aa-1e8b-4b6e-a621-35588cda232a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:17.276586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-23fc29aa-1e8b-4b6e-a621-35588cda232a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:17.277344 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-23fc29aa-1e8b-4b6e-a621-35588cda232a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:17.277778 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-23fc29aa-1e8b-4b6e-a621-35588cda232a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:17.361594 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-23fc29aa-1e8b-4b6e-a621-35588cda232a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.097341 Aug 19 09:28:17.362217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 654/1282] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:17 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:18.373651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ab12b2ea-3b10-4f01-b8a1-d96cd4d723f7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:18.374707 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ab12b2ea-3b10-4f01-b8a1-d96cd4d723f7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:18.381634 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ab12b2ea-3b10-4f01-b8a1-d96cd4d723f7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:18.382077 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ab12b2ea-3b10-4f01-b8a1-d96cd4d723f7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:18.382831 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ab12b2ea-3b10-4f01-b8a1-d96cd4d723f7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:18.383293 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ab12b2ea-3b10-4f01-b8a1-d96cd4d723f7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:18.479586 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ab12b2ea-3b10-4f01-b8a1-d96cd4d723f7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.109706 Aug 19 09:28:18.480209 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 629/1283] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:18 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:19.401537 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-35106a53-4929-45da-8cb9-4dbe1ff3d340 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:19.402532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-35106a53-4929-45da-8cb9-4dbe1ff3d340 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:19.408971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35106a53-4929-45da-8cb9-4dbe1ff3d340 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:19.409422 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35106a53-4929-45da-8cb9-4dbe1ff3d340 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:19.410179 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35106a53-4929-45da-8cb9-4dbe1ff3d340 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:19.410615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35106a53-4929-45da-8cb9-4dbe1ff3d340 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:19.439336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-35106a53-4929-45da-8cb9-4dbe1ff3d340 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041892 Aug 19 09:28:19.439874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 655/1284] 10.222.0.32 () {60 vars in 1343 bytes} [Thu Aug 19 09:28:19 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:28:19.491907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-03b96e37-e18c-43c6-a5a3-626e815f8457 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:19.492892 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-03b96e37-e18c-43c6-a5a3-626e815f8457 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:19.498343 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a2b4f619-6ce9-4eb7-8676-5efec5603a8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:19.498838 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a2b4f619-6ce9-4eb7-8676-5efec5603a8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:19.499556 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-03b96e37-e18c-43c6-a5a3-626e815f8457 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:19.500017 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-03b96e37-e18c-43c6-a5a3-626e815f8457 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:19.501773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-03b96e37-e18c-43c6-a5a3-626e815f8457 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:19.502209 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-03b96e37-e18c-43c6-a5a3-626e815f8457 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:19.505351 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2b4f619-6ce9-4eb7-8676-5efec5603a8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:19.505796 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2b4f619-6ce9-4eb7-8676-5efec5603a8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:19.506555 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2b4f619-6ce9-4eb7-8676-5efec5603a8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:19.507003 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a2b4f619-6ce9-4eb7-8676-5efec5603a8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:19.530894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a2b4f619-6ce9-4eb7-8676-5efec5603a8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Going to try to terminate instance {{(pid=107957) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:28:19.582335 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-03b96e37-e18c-43c6-a5a3-626e815f8457 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.094115 Aug 19 09:28:19.583095 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 630/1285] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:19 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:19.608783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a2b4f619-6ce9-4eb7-8676-5efec5603a8c tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "DELETE /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 204 len: 0 microversion: 2.20 time: 0.112990 Aug 19 09:28:19.610103 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 656/1286] 10.222.0.32 () {60 vars in 1280 bytes} [Thu Aug 19 09:28:19 2021] DELETE /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 19 09:28:19.618590 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ff93002a-76ce-4f9c-882e-a73599bb6f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:19.619339 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ff93002a-76ce-4f9c-882e-a73599bb6f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:19.626491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff93002a-76ce-4f9c-882e-a73599bb6f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:19.626955 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff93002a-76ce-4f9c-882e-a73599bb6f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:19.627761 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff93002a-76ce-4f9c-882e-a73599bb6f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:19.628196 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ff93002a-76ce-4f9c-882e-a73599bb6f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:19.799896 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ff93002a-76ce-4f9c-882e-a73599bb6f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:28:19.807485 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ff93002a-76ce-4f9c-882e-a73599bb6f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:28:19.808972 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ff93002a-76ce-4f9c-882e-a73599bb6f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:28:19.810103 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ff93002a-76ce-4f9c-882e-a73599bb6f78 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.195623 Aug 19 09:28:19.810655 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 631/1287] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:28:19 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 19 09:28:20.594397 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2e5dc7b0-eb82-4751-af03-ff34d3bef927 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:20.595413 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2e5dc7b0-eb82-4751-af03-ff34d3bef927 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:20.602041 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2e5dc7b0-eb82-4751-af03-ff34d3bef927 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:20.602477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2e5dc7b0-eb82-4751-af03-ff34d3bef927 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:20.603236 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2e5dc7b0-eb82-4751-af03-ff34d3bef927 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:20.603683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2e5dc7b0-eb82-4751-af03-ff34d3bef927 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:20.735471 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2e5dc7b0-eb82-4751-af03-ff34d3bef927 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.144841 Aug 19 09:28:20.736036 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 657/1288] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:20 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:20.828848 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1eec9d9e-3f71-4766-87be-a1d9c61b516d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:20.829454 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1eec9d9e-3f71-4766-87be-a1d9c61b516d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:20.835605 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1eec9d9e-3f71-4766-87be-a1d9c61b516d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:20.836052 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1eec9d9e-3f71-4766-87be-a1d9c61b516d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:20.836808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1eec9d9e-3f71-4766-87be-a1d9c61b516d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:20.837241 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1eec9d9e-3f71-4766-87be-a1d9c61b516d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:20.959295 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1eec9d9e-3f71-4766-87be-a1d9c61b516d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:28:20.966799 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1eec9d9e-3f71-4766-87be-a1d9c61b516d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:28:20.968322 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1eec9d9e-3f71-4766-87be-a1d9c61b516d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:28:20.969488 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1eec9d9e-3f71-4766-87be-a1d9c61b516d tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1722 microversion: 2.20 time: 0.144342 Aug 19 09:28:20.970031 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 632/1289] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:28:20 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:28:21.747809 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b259888e-0965-416e-8147-4a349a2b3ac9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:21.748987 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b259888e-0965-416e-8147-4a349a2b3ac9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:21.755697 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b259888e-0965-416e-8147-4a349a2b3ac9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:21.756149 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b259888e-0965-416e-8147-4a349a2b3ac9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:21.756933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b259888e-0965-416e-8147-4a349a2b3ac9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:21.757365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b259888e-0965-416e-8147-4a349a2b3ac9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:21.840371 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b259888e-0965-416e-8147-4a349a2b3ac9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.096538 Aug 19 09:28:21.841014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 658/1290] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:21 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:21.987582 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-24bb3f6d-0cec-4455-a680-0b9699786fda tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:21.988214 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-24bb3f6d-0cec-4455-a680-0b9699786fda tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:21.993958 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24bb3f6d-0cec-4455-a680-0b9699786fda tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:21.994406 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24bb3f6d-0cec-4455-a680-0b9699786fda tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:21.995168 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24bb3f6d-0cec-4455-a680-0b9699786fda tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:21.995630 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24bb3f6d-0cec-4455-a680-0b9699786fda tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:22.090871 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-24bb3f6d-0cec-4455-a680-0b9699786fda tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:28:22.099809 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-24bb3f6d-0cec-4455-a680-0b9699786fda tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:28:22.101320 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-24bb3f6d-0cec-4455-a680-0b9699786fda tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90d8d5eeacf74470bd13713074a281db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a913122239e44edb71a2fd07a99b275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:28:22.102459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-24bb3f6d-0cec-4455-a680-0b9699786fda tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 200 len: 1654 microversion: 2.20 time: 0.118718 Aug 19 09:28:22.103007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 633/1291] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:28:21 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 1654 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 19 09:28:22.424927 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-827bebd1-4cfd-4d2e-a3f2-f9503b1a71cb req-63b104f3-b89a-4466-bfdf-078c38a75b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89098f09-c8cd-4e15-bef5-1bc104634225", "name": "network-vif-deleted", "tag": "c72c5439-5706-4605-91f9-225118f3705b"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:22.426478 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:28:22.426478 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:28:22.434758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-827bebd1-4cfd-4d2e-a3f2-f9503b1a71cb req-63b104f3-b89a-4466-bfdf-078c38a75b96 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:22.435207 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-827bebd1-4cfd-4d2e-a3f2-f9503b1a71cb req-63b104f3-b89a-4466-bfdf-078c38a75b96 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:22.450180 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-827bebd1-4cfd-4d2e-a3f2-f9503b1a71cb req-63b104f3-b89a-4466-bfdf-078c38a75b96 service nova] Creating event network-vif-deleted:c72c5439-5706-4605-91f9-225118f3705b for instance 89098f09-c8cd-4e15-bef5-1bc104634225 on hv-cinder-77387 Aug 19 09:28:22.457002 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-827bebd1-4cfd-4d2e-a3f2-f9503b1a71cb req-63b104f3-b89a-4466-bfdf-078c38a75b96 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109986 Aug 19 09:28:22.457914 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 659/1292] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:28:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:28:22.853064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-64b5aa15-ba9c-4cd3-bc51-e7d9b9f58570 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:22.853976 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-64b5aa15-ba9c-4cd3-bc51-e7d9b9f58570 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:22.860695 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-64b5aa15-ba9c-4cd3-bc51-e7d9b9f58570 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:22.861139 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-64b5aa15-ba9c-4cd3-bc51-e7d9b9f58570 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:22.862001 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-64b5aa15-ba9c-4cd3-bc51-e7d9b9f58570 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:22.862439 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-64b5aa15-ba9c-4cd3-bc51-e7d9b9f58570 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:22.953069 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-64b5aa15-ba9c-4cd3-bc51-e7d9b9f58570 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.103347 Aug 19 09:28:22.953745 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 634/1293] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:22 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:23.121091 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-186e97c4-1355-4554-b149-7c41a0da5062 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:23.121786 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-186e97c4-1355-4554-b149-7c41a0da5062 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:23.128481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-186e97c4-1355-4554-b149-7c41a0da5062 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:23.128930 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-186e97c4-1355-4554-b149-7c41a0da5062 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:23.129703 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-186e97c4-1355-4554-b149-7c41a0da5062 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:23.130257 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-186e97c4-1355-4554-b149-7c41a0da5062 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:23.144109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-186e97c4-1355-4554-b149-7c41a0da5062 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] HTTP exception thrown: Instance 89098f09-c8cd-4e15-bef5-1bc104634225 could not be found. Aug 19 09:28:23.144708 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-186e97c4-1355-4554-b149-7c41a0da5062 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Returning 404 to user: Instance 89098f09-c8cd-4e15-bef5-1bc104634225 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:28:23.145536 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-186e97c4-1355-4554-b149-7c41a0da5062 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 404 len: 111 microversion: 2.20 time: 0.028653 Aug 19 09:28:23.146084 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 660/1294] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Aug 19 09:28:23 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 19 09:28:23.155530 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ef8d199c-b14a-4aaa-b84f-126354a8000a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '.version_select at 0x7fdb852a8430>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:23.175281 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ef8d199c-b14a-4aaa-b84f-126354a8000a tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-943878003" status: 204 len: 0 microversion: 2.20 time: 0.024390 Aug 19 09:28:23.175897 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 635/1295] 10.222.0.32 () {60 vars in 1259 bytes} [Thu Aug 19 09:28:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-943878003 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 19 09:28:23.964516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-766f1ab6-1852-46ad-b378-c90d22d8d673 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:23.965352 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-766f1ab6-1852-46ad-b378-c90d22d8d673 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:23.971410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-766f1ab6-1852-46ad-b378-c90d22d8d673 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:23.971854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-766f1ab6-1852-46ad-b378-c90d22d8d673 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:23.972602 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-766f1ab6-1852-46ad-b378-c90d22d8d673 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:23.973284 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-766f1ab6-1852-46ad-b378-c90d22d8d673 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:24.054223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-766f1ab6-1852-46ad-b378-c90d22d8d673 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.093196 Aug 19 09:28:24.054847 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 661/1296] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:23 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:24.965495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0555f5a4-f847-4e24-86fd-2247fae78da6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:24.966104 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0555f5a4-f847-4e24-86fd-2247fae78da6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:24.975594 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0555f5a4-f847-4e24-86fd-2247fae78da6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:24.976088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0555f5a4-f847-4e24-86fd-2247fae78da6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:24.976915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0555f5a4-f847-4e24-86fd-2247fae78da6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:24.977357 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0555f5a4-f847-4e24-86fd-2247fae78da6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:24.992569 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-0555f5a4-f847-4e24-86fd-2247fae78da6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] HTTP exception thrown: Instance 89098f09-c8cd-4e15-bef5-1bc104634225 could not be found. Aug 19 09:28:24.993181 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0555f5a4-f847-4e24-86fd-2247fae78da6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Returning 404 to user: Instance 89098f09-c8cd-4e15-bef5-1bc104634225 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:28:24.994026 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0555f5a4-f847-4e24-86fd-2247fae78da6 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "DELETE /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 404 len: 111 microversion: 2.1 time: 0.032223 Aug 19 09:28:24.994584 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 636/1297] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:28:24 2021] DELETE /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:28:25.003577 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1e63b957-1968-4f90-87e1-48cd719d94f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:25.004271 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-1e63b957-1968-4f90-87e1-48cd719d94f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 89098f09-c8cd-4e15-bef5-1bc104634225] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:25.010870 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1e63b957-1968-4f90-87e1-48cd719d94f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:25.011339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1e63b957-1968-4f90-87e1-48cd719d94f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:25.012109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1e63b957-1968-4f90-87e1-48cd719d94f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:25.012539 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-1e63b957-1968-4f90-87e1-48cd719d94f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:25.031745 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-1e63b957-1968-4f90-87e1-48cd719d94f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] HTTP exception thrown: Instance 89098f09-c8cd-4e15-bef5-1bc104634225 could not be found. Aug 19 09:28:25.032435 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-1e63b957-1968-4f90-87e1-48cd719d94f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Returning 404 to user: Instance 89098f09-c8cd-4e15-bef5-1bc104634225 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:28:25.033623 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-1e63b957-1968-4f90-87e1-48cd719d94f7 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225" status: 404 len: 111 microversion: 2.1 time: 0.034305 Aug 19 09:28:25.034171 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 662/1298] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:28:24 2021] GET /compute/v2.1/servers/89098f09-c8cd-4e15-bef5-1bc104634225 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 09:28:25.066217 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e2527e5a-93d4-4b6e-a391-f7f9bf5ccdc5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:25.067113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e2527e5a-93d4-4b6e-a391-f7f9bf5ccdc5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:25.073294 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e2527e5a-93d4-4b6e-a391-f7f9bf5ccdc5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:25.073744 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e2527e5a-93d4-4b6e-a391-f7f9bf5ccdc5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:25.074506 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e2527e5a-93d4-4b6e-a391-f7f9bf5ccdc5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:25.074936 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e2527e5a-93d4-4b6e-a391-f7f9bf5ccdc5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:25.158175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e2527e5a-93d4-4b6e-a391-f7f9bf5ccdc5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.095955 Aug 19 09:28:25.158764 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 637/1299] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:25 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:26.166251 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f7d5867b-7d64-4a35-9acf-f30e305e1135 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:26.166812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f7d5867b-7d64-4a35-9acf-f30e305e1135 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:26.169743 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6c17acd7-bd03-4674-ab25-e3f486df4cc6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:26.170730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6c17acd7-bd03-4674-ab25-e3f486df4cc6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:26.173751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f7d5867b-7d64-4a35-9acf-f30e305e1135 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:26.174192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f7d5867b-7d64-4a35-9acf-f30e305e1135 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:26.174947 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f7d5867b-7d64-4a35-9acf-f30e305e1135 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:26.175402 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f7d5867b-7d64-4a35-9acf-f30e305e1135 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:26.177651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6c17acd7-bd03-4674-ab25-e3f486df4cc6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:26.178157 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6c17acd7-bd03-4674-ab25-e3f486df4cc6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:26.178981 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6c17acd7-bd03-4674-ab25-e3f486df4cc6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:26.179514 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6c17acd7-bd03-4674-ab25-e3f486df4cc6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:26.188999 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-f7d5867b-7d64-4a35-9acf-f30e305e1135 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] HTTP exception thrown: Instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c could not be found. Aug 19 09:28:26.189574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f7d5867b-7d64-4a35-9acf-f30e305e1135 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Returning 404 to user: Instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:28:26.190399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f7d5867b-7d64-4a35-9acf-f30e305e1135 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 404 len: 111 microversion: 2.1 time: 0.027746 Aug 19 09:28:26.191132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 663/1300] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:28:26 2021] DELETE /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:28:26.198422 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6f9ed26b-15dc-4f32-8c7c-836f757a4851 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:26.199012 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6f9ed26b-15dc-4f32-8c7c-836f757a4851 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] [instance: 7ed06d0a-7ee6-4f00-b470-b19d7331667c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:26.204913 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f9ed26b-15dc-4f32-8c7c-836f757a4851 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:26.205358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f9ed26b-15dc-4f32-8c7c-836f757a4851 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:26.206129 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f9ed26b-15dc-4f32-8c7c-836f757a4851 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:26.206588 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f9ed26b-15dc-4f32-8c7c-836f757a4851 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:26.219527 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-6f9ed26b-15dc-4f32-8c7c-836f757a4851 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] HTTP exception thrown: Instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c could not be found. Aug 19 09:28:26.220110 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6f9ed26b-15dc-4f32-8c7c-836f757a4851 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] Returning 404 to user: Instance 7ed06d0a-7ee6-4f00-b470-b19d7331667c could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:28:26.220917 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6f9ed26b-15dc-4f32-8c7c-836f757a4851 tempest-AttachVolumeShelveTestJSON-1560467775 tempest-AttachVolumeShelveTestJSON-1560467775-project] 10.222.0.32 "GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c" status: 404 len: 111 microversion: 2.1 time: 0.025983 Aug 19 09:28:26.221427 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 664/1301] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:28:26 2021] GET /compute/v2.1/servers/7ed06d0a-7ee6-4f00-b470-b19d7331667c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 09:28:26.260902 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6c17acd7-bd03-4674-ab25-e3f486df4cc6 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.094952 Aug 19 09:28:26.261697 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 638/1302] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:26 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:28:27.272565 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-33e52245-b96c-49c5-873d-b7110400e85b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:27.273468 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-33e52245-b96c-49c5-873d-b7110400e85b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:27.279167 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-33e52245-b96c-49c5-873d-b7110400e85b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:27.279644 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-33e52245-b96c-49c5-873d-b7110400e85b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:27.280397 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-33e52245-b96c-49c5-873d-b7110400e85b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:27.280831 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-33e52245-b96c-49c5-873d-b7110400e85b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:27.371680 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-33e52245-b96c-49c5-873d-b7110400e85b tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.102534 Aug 19 09:28:27.372560 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 665/1303] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:27 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:28:28.384442 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c0ad796c-5e52-4702-8c96-6c73bed5f9cc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:28.385712 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c0ad796c-5e52-4702-8c96-6c73bed5f9cc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:28.392699 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c0ad796c-5e52-4702-8c96-6c73bed5f9cc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:28.393219 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c0ad796c-5e52-4702-8c96-6c73bed5f9cc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:28.394058 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c0ad796c-5e52-4702-8c96-6c73bed5f9cc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:28.394516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c0ad796c-5e52-4702-8c96-6c73bed5f9cc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:28.476352 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c0ad796c-5e52-4702-8c96-6c73bed5f9cc tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.095779 Aug 19 09:28:28.476948 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 639/1304] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:28 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:29.491164 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ea434eac-c578-4fc6-8f40-f24ea9abb15c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:29.492191 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ea434eac-c578-4fc6-8f40-f24ea9abb15c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:29.498921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea434eac-c578-4fc6-8f40-f24ea9abb15c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:29.499379 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea434eac-c578-4fc6-8f40-f24ea9abb15c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:29.501731 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea434eac-c578-4fc6-8f40-f24ea9abb15c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:29.501731 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ea434eac-c578-4fc6-8f40-f24ea9abb15c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:29.586915 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ea434eac-c578-4fc6-8f40-f24ea9abb15c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.102514 Aug 19 09:28:29.587866 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 666/1305] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:29 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:30.600314 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e40b2ab9-b990-4037-a068-d8558114455a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:30.601315 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e40b2ab9-b990-4037-a068-d8558114455a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:30.607911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e40b2ab9-b990-4037-a068-d8558114455a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:30.608358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e40b2ab9-b990-4037-a068-d8558114455a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:30.609114 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e40b2ab9-b990-4037-a068-d8558114455a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:30.610144 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e40b2ab9-b990-4037-a068-d8558114455a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:30.692257 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e40b2ab9-b990-4037-a068-d8558114455a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.096112 Aug 19 09:28:30.693128 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 640/1306] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:30 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:31.704311 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6969ecf4-9a7f-4a53-a77e-efc97c8fe452 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:31.706573 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6969ecf4-9a7f-4a53-a77e-efc97c8fe452 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:31.713525 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6969ecf4-9a7f-4a53-a77e-efc97c8fe452 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:31.714035 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6969ecf4-9a7f-4a53-a77e-efc97c8fe452 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:31.714840 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6969ecf4-9a7f-4a53-a77e-efc97c8fe452 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:31.715295 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6969ecf4-9a7f-4a53-a77e-efc97c8fe452 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:31.800261 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6969ecf4-9a7f-4a53-a77e-efc97c8fe452 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.100096 Aug 19 09:28:31.804385 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 667/1307] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:31 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:32.812568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-fa5a53f4-61df-418d-b46e-9dc1a3f43149 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:32.813566 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-fa5a53f4-61df-418d-b46e-9dc1a3f43149 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:32.821205 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fa5a53f4-61df-418d-b46e-9dc1a3f43149 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:32.821658 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fa5a53f4-61df-418d-b46e-9dc1a3f43149 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:32.822461 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fa5a53f4-61df-418d-b46e-9dc1a3f43149 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:32.822894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fa5a53f4-61df-418d-b46e-9dc1a3f43149 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:32.902289 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-fa5a53f4-61df-418d-b46e-9dc1a3f43149 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.093420 Aug 19 09:28:32.906598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 641/1308] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:32 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:33.915087 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-180270e0-5052-445b-9547-d59209c1771c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:33.916107 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-180270e0-5052-445b-9547-d59209c1771c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:33.922420 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-180270e0-5052-445b-9547-d59209c1771c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:33.922865 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-180270e0-5052-445b-9547-d59209c1771c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:33.924273 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-180270e0-5052-445b-9547-d59209c1771c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:33.924705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-180270e0-5052-445b-9547-d59209c1771c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:34.004849 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-180270e0-5052-445b-9547-d59209c1771c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.093609 Aug 19 09:28:34.008747 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 668/1309] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:33 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:35.016580 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7f5062a6-a9bb-4484-ad13-3d7277078d62 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:35.018450 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7f5062a6-a9bb-4484-ad13-3d7277078d62 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:35.025010 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f5062a6-a9bb-4484-ad13-3d7277078d62 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:35.025459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f5062a6-a9bb-4484-ad13-3d7277078d62 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:35.026231 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f5062a6-a9bb-4484-ad13-3d7277078d62 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:35.026669 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f5062a6-a9bb-4484-ad13-3d7277078d62 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:35.115105 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7f5062a6-a9bb-4484-ad13-3d7277078d62 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.102440 Aug 19 09:28:35.116057 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 642/1310] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:35 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:36.127650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-587a6878-1e17-4030-8510-37239c68d037 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:36.128645 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-587a6878-1e17-4030-8510-37239c68d037 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:36.135059 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-587a6878-1e17-4030-8510-37239c68d037 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:36.135530 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-587a6878-1e17-4030-8510-37239c68d037 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:36.136284 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-587a6878-1e17-4030-8510-37239c68d037 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:36.136711 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-587a6878-1e17-4030-8510-37239c68d037 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:36.216819 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-587a6878-1e17-4030-8510-37239c68d037 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.093611 Aug 19 09:28:36.220874 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 669/1311] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:36 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:28:37.228955 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5b3735ad-ff8a-4ba9-946c-157c3b57ca46 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:37.229948 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5b3735ad-ff8a-4ba9-946c-157c3b57ca46 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:37.237259 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5b3735ad-ff8a-4ba9-946c-157c3b57ca46 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:37.237704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5b3735ad-ff8a-4ba9-946c-157c3b57ca46 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:37.238460 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5b3735ad-ff8a-4ba9-946c-157c3b57ca46 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:37.238893 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5b3735ad-ff8a-4ba9-946c-157c3b57ca46 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:37.320202 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5b3735ad-ff8a-4ba9-946c-157c3b57ca46 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.095108 Aug 19 09:28:37.321061 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 643/1312] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:37 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:38.332466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b5b360bc-f5bc-48a3-ad9e-68ba8076db23 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:38.333378 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b5b360bc-f5bc-48a3-ad9e-68ba8076db23 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:38.339713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5b360bc-f5bc-48a3-ad9e-68ba8076db23 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:38.340162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5b360bc-f5bc-48a3-ad9e-68ba8076db23 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:38.340917 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5b360bc-f5bc-48a3-ad9e-68ba8076db23 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:38.341351 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b5b360bc-f5bc-48a3-ad9e-68ba8076db23 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:38.421264 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b5b360bc-f5bc-48a3-ad9e-68ba8076db23 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.093588 Aug 19 09:28:38.421890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 670/1313] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:38 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:39.433133 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-44acdb0f-d120-4d7d-8043-14b33c0dcb78 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:39.434458 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-44acdb0f-d120-4d7d-8043-14b33c0dcb78 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:39.441454 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-44acdb0f-d120-4d7d-8043-14b33c0dcb78 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:39.441901 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-44acdb0f-d120-4d7d-8043-14b33c0dcb78 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:39.442663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-44acdb0f-d120-4d7d-8043-14b33c0dcb78 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:39.443088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-44acdb0f-d120-4d7d-8043-14b33c0dcb78 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:39.540567 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-44acdb0f-d120-4d7d-8043-14b33c0dcb78 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.111185 Aug 19 09:28:39.541211 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 644/1314] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:39 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:40.553900 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-794aaf82-196f-4c5f-aa99-4b27a9555355 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:40.554888 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-794aaf82-196f-4c5f-aa99-4b27a9555355 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:40.561576 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-794aaf82-196f-4c5f-aa99-4b27a9555355 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:40.562039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-794aaf82-196f-4c5f-aa99-4b27a9555355 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:40.562614 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-794aaf82-196f-4c5f-aa99-4b27a9555355 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:40.563039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-794aaf82-196f-4c5f-aa99-4b27a9555355 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:40.645058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-794aaf82-196f-4c5f-aa99-4b27a9555355 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.095447 Aug 19 09:28:40.646346 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 671/1315] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:40 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:41.656834 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f3e34c9e-77b9-469c-8d20-a5db6c482989 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:41.658565 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f3e34c9e-77b9-469c-8d20-a5db6c482989 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:41.664824 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f3e34c9e-77b9-469c-8d20-a5db6c482989 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:41.665262 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f3e34c9e-77b9-469c-8d20-a5db6c482989 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:41.666017 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f3e34c9e-77b9-469c-8d20-a5db6c482989 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:41.666442 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f3e34c9e-77b9-469c-8d20-a5db6c482989 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:41.747322 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f3e34c9e-77b9-469c-8d20-a5db6c482989 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28714 microversion: 2.1 time: 0.094195 Aug 19 09:28:41.748349 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 645/1316] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:41 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28714 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:42.758571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-51d659c9-87ba-4870-ae27-7cf606b0c5b2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:42.759583 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-51d659c9-87ba-4870-ae27-7cf606b0c5b2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:42.765818 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-51d659c9-87ba-4870-ae27-7cf606b0c5b2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:42.766257 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-51d659c9-87ba-4870-ae27-7cf606b0c5b2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:42.767219 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-51d659c9-87ba-4870-ae27-7cf606b0c5b2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:42.767671 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-51d659c9-87ba-4870-ae27-7cf606b0c5b2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:42.865761 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-51d659c9-87ba-4870-ae27-7cf606b0c5b2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 28833 microversion: 2.1 time: 0.110937 Aug 19 09:28:42.867465 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 672/1317] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:42 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 28833 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:43.878455 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-39d73ae9-0e53-4686-851c-a699050b487e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:43.879459 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-39d73ae9-0e53-4686-851c-a699050b487e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:43.885850 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-39d73ae9-0e53-4686-851c-a699050b487e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:43.886288 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-39d73ae9-0e53-4686-851c-a699050b487e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:43.887049 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-39d73ae9-0e53-4686-851c-a699050b487e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:43.887509 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-39d73ae9-0e53-4686-851c-a699050b487e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:43.975468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-39d73ae9-0e53-4686-851c-a699050b487e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 31040 microversion: 2.1 time: 0.101380 Aug 19 09:28:43.976113 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 646/1318] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:43 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 31040 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:44.988078 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-37ffb4d6-65d5-4e69-98d7-c6c2e67fe5e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:44.989141 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-37ffb4d6-65d5-4e69-98d7-c6c2e67fe5e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:45.000925 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-37ffb4d6-65d5-4e69-98d7-c6c2e67fe5e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:45.001538 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-37ffb4d6-65d5-4e69-98d7-c6c2e67fe5e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:45.002508 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-37ffb4d6-65d5-4e69-98d7-c6c2e67fe5e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:45.004343 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-37ffb4d6-65d5-4e69-98d7-c6c2e67fe5e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:45.102566 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-37ffb4d6-65d5-4e69-98d7-c6c2e67fe5e5 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 32641 microversion: 2.1 time: 0.119386 Aug 19 09:28:45.103192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 673/1319] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:44 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 32641 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:46.114363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6e68319e-0411-403a-8d39-7aa8459e7d6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:46.115430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6e68319e-0411-403a-8d39-7aa8459e7d6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:46.122333 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6e68319e-0411-403a-8d39-7aa8459e7d6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:46.122775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6e68319e-0411-403a-8d39-7aa8459e7d6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:46.123549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6e68319e-0411-403a-8d39-7aa8459e7d6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:46.123977 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6e68319e-0411-403a-8d39-7aa8459e7d6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:49.409405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6e68319e-0411-403a-8d39-7aa8459e7d6e tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 37942 microversion: 2.1 time: 3.298846 Aug 19 09:28:49.410064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 647/1320] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:46 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 37942 bytes in 3301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:50.421049 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-75ddf5d7-6609-4e9b-9c5f-d64d273f31f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:50.422053 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-75ddf5d7-6609-4e9b-9c5f-d64d273f31f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:50.428974 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75ddf5d7-6609-4e9b-9c5f-d64d273f31f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:50.429413 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75ddf5d7-6609-4e9b-9c5f-d64d273f31f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:50.430163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75ddf5d7-6609-4e9b-9c5f-d64d273f31f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:50.430585 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75ddf5d7-6609-4e9b-9c5f-d64d273f31f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:50.514442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-75ddf5d7-6609-4e9b-9c5f-d64d273f31f9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 38249 microversion: 2.1 time: 0.097283 Aug 19 09:28:50.515083 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 674/1321] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:50 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 38249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:51.526619 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2bba5db0-ef2b-4d80-a956-f5a2d14eab82 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:51.527624 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2bba5db0-ef2b-4d80-a956-f5a2d14eab82 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:51.534740 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2bba5db0-ef2b-4d80-a956-f5a2d14eab82 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:51.535175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2bba5db0-ef2b-4d80-a956-f5a2d14eab82 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:51.535951 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2bba5db0-ef2b-4d80-a956-f5a2d14eab82 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:51.536379 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2bba5db0-ef2b-4d80-a956-f5a2d14eab82 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:51.620937 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2bba5db0-ef2b-4d80-a956-f5a2d14eab82 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 38249 microversion: 2.1 time: 0.098173 Aug 19 09:28:51.621570 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 648/1322] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:51 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 38249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:52.633200 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0c6276c8-90cc-411e-a354-eea025c3df8f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:52.634181 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0c6276c8-90cc-411e-a354-eea025c3df8f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:52.640625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c6276c8-90cc-411e-a354-eea025c3df8f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:52.641060 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c6276c8-90cc-411e-a354-eea025c3df8f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:52.641809 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c6276c8-90cc-411e-a354-eea025c3df8f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:52.642235 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c6276c8-90cc-411e-a354-eea025c3df8f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:52.724628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0c6276c8-90cc-411e-a354-eea025c3df8f tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 38249 microversion: 2.1 time: 0.095280 Aug 19 09:28:52.725244 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 675/1323] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:52 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 38249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:53.736809 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-02c662e7-d417-49a6-ae6a-1fb180f1fbbe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:53.738608 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-02c662e7-d417-49a6-ae6a-1fb180f1fbbe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:53.745156 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-02c662e7-d417-49a6-ae6a-1fb180f1fbbe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:53.745604 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-02c662e7-d417-49a6-ae6a-1fb180f1fbbe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:53.746372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-02c662e7-d417-49a6-ae6a-1fb180f1fbbe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:53.746804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-02c662e7-d417-49a6-ae6a-1fb180f1fbbe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:53.828227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-02c662e7-d417-49a6-ae6a-1fb180f1fbbe tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 38249 microversion: 2.1 time: 0.095280 Aug 19 09:28:53.832897 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 649/1324] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:53 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 38249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 19 09:28:54.840206 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9495a5a9-b375-486f-a68f-0654939813c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:54.841202 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9495a5a9-b375-486f-a68f-0654939813c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:54.849115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9495a5a9-b375-486f-a68f-0654939813c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:54.849732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9495a5a9-b375-486f-a68f-0654939813c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:54.850514 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9495a5a9-b375-486f-a68f-0654939813c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:54.850972 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9495a5a9-b375-486f-a68f-0654939813c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:54.939042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9495a5a9-b375-486f-a68f-0654939813c7 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action" status: 200 len: 38380 microversion: 2.1 time: 0.102756 Aug 19 09:28:54.939734 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 676/1325] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:28:54 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/action => generated 38380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 19 09:28:54.950712 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b61a5cfc-b146-4cf3-b7bc-87a40932c9d0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:28:54.951385 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b61a5cfc-b146-4cf3-b7bc-87a40932c9d0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:54.958397 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b61a5cfc-b146-4cf3-b7bc-87a40932c9d0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:54.958979 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b61a5cfc-b146-4cf3-b7bc-87a40932c9d0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:54.959862 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b61a5cfc-b146-4cf3-b7bc-87a40932c9d0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:54.960305 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b61a5cfc-b146-4cf3-b7bc-87a40932c9d0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:54.983946 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b61a5cfc-b146-4cf3-b7bc-87a40932c9d0 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/ips" status: 200 len: 146 microversion: 2.1 time: 0.037338 Aug 19 09:28:54.984515 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 650/1326] 10.222.0.32 () {58 vars in 1248 bytes} [Thu Aug 19 09:28:54 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:28:56.311940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b636aaa4-e256-4931-bfde-21e89e50b641 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d83cbf3a-ef4d-474e-ae67-bcbb98b108c4"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:28:56.313102 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b636aaa4-e256-4931-bfde-21e89e50b641 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:28:56.319788 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b636aaa4-e256-4931-bfde-21e89e50b641 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:56.320233 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b636aaa4-e256-4931-bfde-21e89e50b641 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:56.321012 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b636aaa4-e256-4931-bfde-21e89e50b641 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:28:56.321438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b636aaa4-e256-4931-bfde-21e89e50b641 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:28:56.561898 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b636aaa4-e256-4931-bfde-21e89e50b641 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253937 Aug 19 09:28:56.562492 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 677/1327] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:28:56 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:04.073769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f6f609e8-e693-4b2d-83d3-8583ff8541e9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:04.074775 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f6f609e8-e693-4b2d-83d3-8583ff8541e9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:04.080905 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f6f609e8-e693-4b2d-83d3-8583ff8541e9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:04.081347 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f6f609e8-e693-4b2d-83d3-8583ff8541e9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:04.082106 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f6f609e8-e693-4b2d-83d3-8583ff8541e9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:04.082527 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f6f609e8-e693-4b2d-83d3-8583ff8541e9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:04.111945 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f6f609e8-e693-4b2d-83d3-8583ff8541e9 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041896 Aug 19 09:29:04.112488 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 651/1328] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:29:04 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:04.123531 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d1394365-979d-42a2-9cae-878f280d2db4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:04.124139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d1394365-979d-42a2-9cae-878f280d2db4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:04.130557 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d1394365-979d-42a2-9cae-878f280d2db4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:04.131001 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d1394365-979d-42a2-9cae-878f280d2db4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:04.131791 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d1394365-979d-42a2-9cae-878f280d2db4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:04.132222 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d1394365-979d-42a2-9cae-878f280d2db4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:04.161829 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d1394365-979d-42a2-9cae-878f280d2db4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments/d83cbf3a-ef4d-474e-ae67-bcbb98b108c4" status: 200 len: 194 microversion: 2.1 time: 0.042519 Aug 19 09:29:04.162396 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 678/1329] 10.222.0.32 () {58 vars in 1413 bytes} [Thu Aug 19 09:29:04 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments/d83cbf3a-ef4d-474e-ae67-bcbb98b108c4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:05.469468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d1867c5d-0e2a-4214-864c-a805900a5400 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00d9951f-194b-40ce-97e0-69b029ffc4d4"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:29:05.470657 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d1867c5d-0e2a-4214-864c-a805900a5400 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:05.477118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d1867c5d-0e2a-4214-864c-a805900a5400 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:05.477559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d1867c5d-0e2a-4214-864c-a805900a5400 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:05.478644 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d1867c5d-0e2a-4214-864c-a805900a5400 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:05.479088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d1867c5d-0e2a-4214-864c-a805900a5400 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:05.746650 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d1867c5d-0e2a-4214-864c-a805900a5400 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280954 Aug 19 09:29:05.747247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 652/1330] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:29:05 2021] POST /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:07.987853 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1843110570", "imageRef": "ce51777b-b3de-459b-92ed-085a3ef0206c", "flavorRef": "452"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:29:08.037936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.network.neutron [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] validate_networks() for None {{(pid=107957) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:29:08.298280 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Flavor limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:29:08.298698 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Image limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:29:08.299171 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Flavor pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:29:08.299615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Image pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:29:08.300028 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:29:08.309020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:08.309466 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:08.310258 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:08.310691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:08.326193 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Getting quotas for project 9ecf484c1f8e4c35bd5bd99739db3cc6. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:29:08.329973 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Getting quotas for user 1f40c8fa6fd64177b6b68a6fffa7549d and project 9ecf484c1f8e4c35bd5bd99739db3cc6. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:29:08.340382 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Going to run 1 instances... {{(pid=107957) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:29:08.342591 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ce51777b-b3de-459b-92ed-085a3ef0206c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:29:08.387105 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b1582b86-333d-4a37-9ae2-16abb1b9adff tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.402838 Aug 19 09:29:08.387783 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 679/1331] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:29:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:29:08.399151 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7cd21133-85d4-48e7-9c66-3a836cc8b4da tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:08.400926 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7cd21133-85d4-48e7-9c66-3a836cc8b4da tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:08.454185 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7cd21133-85d4-48e7-9c66-3a836cc8b4da tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:08.461546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7cd21133-85d4-48e7-9c66-3a836cc8b4da tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1215 microversion: 2.1 time: 0.067501 Aug 19 09:29:08.462194 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 653/1332] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:08 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:09.478053 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-61f7d8c8-2080-47ec-aea8-494811984e27 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:09.478837 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-61f7d8c8-2080-47ec-aea8-494811984e27 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:09.484945 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61f7d8c8-2080-47ec-aea8-494811984e27 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:09.485375 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61f7d8c8-2080-47ec-aea8-494811984e27 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:09.486148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61f7d8c8-2080-47ec-aea8-494811984e27 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:09.486586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61f7d8c8-2080-47ec-aea8-494811984e27 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:09.548188 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-61f7d8c8-2080-47ec-aea8-494811984e27 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:09.557796 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-61f7d8c8-2080-47ec-aea8-494811984e27 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1275 microversion: 2.1 time: 0.083374 Aug 19 09:29:09.558368 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 680/1333] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:09 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:10.574516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9ad141cf-5b36-4d42-84f2-f0c746a56e88 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:10.575076 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9ad141cf-5b36-4d42-84f2-f0c746a56e88 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:10.583665 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ad141cf-5b36-4d42-84f2-f0c746a56e88 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:10.584126 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ad141cf-5b36-4d42-84f2-f0c746a56e88 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:10.584916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ad141cf-5b36-4d42-84f2-f0c746a56e88 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:10.585350 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9ad141cf-5b36-4d42-84f2-f0c746a56e88 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:10.774874 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9ad141cf-5b36-4d42-84f2-f0c746a56e88 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:10.781990 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9ad141cf-5b36-4d42-84f2-f0c746a56e88 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1315 microversion: 2.1 time: 0.211313 Aug 19 09:29:10.782631 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 654/1334] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:10 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:11.034310 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-6b97a6da-88ff-48d5-bcc5-49d2fa2b1980 req-045ce3a8-44b3-4a07-852a-77564d0bee74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4188887-8ddf-4a67-9fd0-ba27eaa3da17", "tag": "71c5fc60-38d2-4300-82d8-c72a4afcc9da"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:29:11.040691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:29:11.040691 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:29:11.049521 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-6b97a6da-88ff-48d5-bcc5-49d2fa2b1980 req-045ce3a8-44b3-4a07-852a-77564d0bee74 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:11.049963 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-6b97a6da-88ff-48d5-bcc5-49d2fa2b1980 req-045ce3a8-44b3-4a07-852a-77564d0bee74 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:11.064798 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-6b97a6da-88ff-48d5-bcc5-49d2fa2b1980 req-045ce3a8-44b3-4a07-852a-77564d0bee74 service nova] Creating event network-changed:71c5fc60-38d2-4300-82d8-c72a4afcc9da for instance b4188887-8ddf-4a67-9fd0-ba27eaa3da17 on hv-cinder-77387 Aug 19 09:29:11.071693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-6b97a6da-88ff-48d5-bcc5-49d2fa2b1980 req-045ce3a8-44b3-4a07-852a-77564d0bee74 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040756 Aug 19 09:29:11.075231 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 681/1335] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:29:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:11.798762 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ceb9896d-0e5f-4a70-be3e-444ae656e393 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:11.799394 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ceb9896d-0e5f-4a70-be3e-444ae656e393 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:11.805145 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ceb9896d-0e5f-4a70-be3e-444ae656e393 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:11.805595 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ceb9896d-0e5f-4a70-be3e-444ae656e393 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:11.806394 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ceb9896d-0e5f-4a70-be3e-444ae656e393 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:11.806827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ceb9896d-0e5f-4a70-be3e-444ae656e393 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:12.003522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ceb9896d-0e5f-4a70-be3e-444ae656e393 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:12.010873 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ceb9896d-0e5f-4a70-be3e-444ae656e393 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1315 microversion: 2.1 time: 0.215774 Aug 19 09:29:12.011460 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 655/1336] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:11 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:13.028894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5b858e93-eb49-4b9a-a2df-ae3c6aa9248e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:13.029513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5b858e93-eb49-4b9a-a2df-ae3c6aa9248e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:13.036518 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5b858e93-eb49-4b9a-a2df-ae3c6aa9248e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:13.036965 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5b858e93-eb49-4b9a-a2df-ae3c6aa9248e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:13.037732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5b858e93-eb49-4b9a-a2df-ae3c6aa9248e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:13.038202 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5b858e93-eb49-4b9a-a2df-ae3c6aa9248e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:13.160767 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5b858e93-eb49-4b9a-a2df-ae3c6aa9248e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:13.167971 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5b858e93-eb49-4b9a-a2df-ae3c6aa9248e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1315 microversion: 2.1 time: 0.143537 Aug 19 09:29:13.168533 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 682/1337] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:13 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:13.279808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-b1a1e0dd-1f1b-408c-872a-61705cef6664 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:13.280720 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-b1a1e0dd-1f1b-408c-872a-61705cef6664 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:13.286912 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b1a1e0dd-1f1b-408c-872a-61705cef6664 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:13.287385 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b1a1e0dd-1f1b-408c-872a-61705cef6664 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:13.288146 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b1a1e0dd-1f1b-408c-872a-61705cef6664 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:13.288579 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-b1a1e0dd-1f1b-408c-872a-61705cef6664 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:13.316748 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-b1a1e0dd-1f1b-408c-872a-61705cef6664 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.040738 Aug 19 09:29:13.317285 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 656/1338] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:29:13 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:13.505288 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0986b379-5346-4478-9803-7914b3ee3939 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:13.505775 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0986b379-5346-4478-9803-7914b3ee3939 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:13.511563 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0986b379-5346-4478-9803-7914b3ee3939 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:13.512007 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0986b379-5346-4478-9803-7914b3ee3939 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:13.512777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0986b379-5346-4478-9803-7914b3ee3939 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:13.513209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0986b379-5346-4478-9803-7914b3ee3939 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:13.541812 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0986b379-5346-4478-9803-7914b3ee3939 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments/d83cbf3a-ef4d-474e-ae67-bcbb98b108c4" status: 200 len: 194 microversion: 2.1 time: 0.040284 Aug 19 09:29:13.542307 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 683/1339] 10.222.0.32 () {58 vars in 1413 bytes} [Thu Aug 19 09:29:13 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments/d83cbf3a-ef4d-474e-ae67-bcbb98b108c4 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:13.551589 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c0a6821c-e993-43dc-9e64-e83e61fc85da tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:13.552088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c0a6821c-e993-43dc-9e64-e83e61fc85da tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:13.557787 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c0a6821c-e993-43dc-9e64-e83e61fc85da tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:13.558233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c0a6821c-e993-43dc-9e64-e83e61fc85da tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:13.558989 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c0a6821c-e993-43dc-9e64-e83e61fc85da tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:13.559457 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c0a6821c-e993-43dc-9e64-e83e61fc85da tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:13.641774 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-c0a6821c-e993-43dc-9e64-e83e61fc85da tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lazy-loading 'services' on Instance uuid 402d3979-28e9-446f-b50d-c5f17f340a4c {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:29:13.706091 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c0a6821c-e993-43dc-9e64-e83e61fc85da tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "DELETE /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments/d83cbf3a-ef4d-474e-ae67-bcbb98b108c4" status: 202 len: 0 microversion: 2.1 time: 0.158149 Aug 19 09:29:13.706657 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 657/1340] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:29:13 2021] DELETE /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments/d83cbf3a-ef4d-474e-ae67-bcbb98b108c4 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:29:14.185157 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-16cf0bc2-45a3-4d7f-8d88-0545c346abc8 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:14.185792 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-16cf0bc2-45a3-4d7f-8d88-0545c346abc8 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:14.192329 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-16cf0bc2-45a3-4d7f-8d88-0545c346abc8 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:14.192781 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-16cf0bc2-45a3-4d7f-8d88-0545c346abc8 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:14.193554 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-16cf0bc2-45a3-4d7f-8d88-0545c346abc8 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:14.194074 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-16cf0bc2-45a3-4d7f-8d88-0545c346abc8 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:14.317387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-16cf0bc2-45a3-4d7f-8d88-0545c346abc8 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:14.324603 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-16cf0bc2-45a3-4d7f-8d88-0545c346abc8 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1315 microversion: 2.1 time: 0.143066 Aug 19 09:29:14.325155 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 684/1341] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:14 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:15.343214 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5a7e25a1-b468-44c4-9596-bf5d603fe809 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:15.344803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5a7e25a1-b468-44c4-9596-bf5d603fe809 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:15.352794 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5a7e25a1-b468-44c4-9596-bf5d603fe809 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:15.353242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5a7e25a1-b468-44c4-9596-bf5d603fe809 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:15.354045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5a7e25a1-b468-44c4-9596-bf5d603fe809 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:15.354486 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5a7e25a1-b468-44c4-9596-bf5d603fe809 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:15.474023 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5a7e25a1-b468-44c4-9596-bf5d603fe809 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:15.481164 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5a7e25a1-b468-44c4-9596-bf5d603fe809 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1315 microversion: 2.1 time: 0.143314 Aug 19 09:29:15.481714 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 658/1342] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:15 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:15.878193 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cfe6e0dc-a2ea-4db8-8803-fa110202be67 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:15.878763 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cfe6e0dc-a2ea-4db8-8803-fa110202be67 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:15.884637 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cfe6e0dc-a2ea-4db8-8803-fa110202be67 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:15.885088 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cfe6e0dc-a2ea-4db8-8803-fa110202be67 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:15.885861 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cfe6e0dc-a2ea-4db8-8803-fa110202be67 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:15.886295 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cfe6e0dc-a2ea-4db8-8803-fa110202be67 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:15.914916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cfe6e0dc-a2ea-4db8-8803-fa110202be67 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments/00d9951f-194b-40ce-97e0-69b029ffc4d4" status: 200 len: 194 microversion: 2.1 time: 0.040514 Aug 19 09:29:15.915515 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 685/1343] 10.222.0.32 () {58 vars in 1413 bytes} [Thu Aug 19 09:29:15 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments/00d9951f-194b-40ce-97e0-69b029ffc4d4 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:15.924875 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c68a2db6-4409-4e89-8f9e-c6f65474d9d4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:15.925363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c68a2db6-4409-4e89-8f9e-c6f65474d9d4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:15.931823 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c68a2db6-4409-4e89-8f9e-c6f65474d9d4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:15.932264 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c68a2db6-4409-4e89-8f9e-c6f65474d9d4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:15.933013 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c68a2db6-4409-4e89-8f9e-c6f65474d9d4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:15.933437 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c68a2db6-4409-4e89-8f9e-c6f65474d9d4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:16.012831 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-c68a2db6-4409-4e89-8f9e-c6f65474d9d4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lazy-loading 'services' on Instance uuid 402d3979-28e9-446f-b50d-c5f17f340a4c {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:29:16.074644 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c68a2db6-4409-4e89-8f9e-c6f65474d9d4 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "DELETE /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments/00d9951f-194b-40ce-97e0-69b029ffc4d4" status: 202 len: 0 microversion: 2.1 time: 0.153301 Aug 19 09:29:16.075297 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 659/1344] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:29:15 2021] DELETE /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments/00d9951f-194b-40ce-97e0-69b029ffc4d4 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:29:16.497609 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d5c7c9a9-3e20-4409-aa36-9ff9a679c3e9 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:16.498213 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d5c7c9a9-3e20-4409-aa36-9ff9a679c3e9 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:16.504207 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5c7c9a9-3e20-4409-aa36-9ff9a679c3e9 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:16.504774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5c7c9a9-3e20-4409-aa36-9ff9a679c3e9 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:16.505526 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5c7c9a9-3e20-4409-aa36-9ff9a679c3e9 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:16.505956 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5c7c9a9-3e20-4409-aa36-9ff9a679c3e9 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:16.624968 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d5c7c9a9-3e20-4409-aa36-9ff9a679c3e9 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:16.632626 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d5c7c9a9-3e20-4409-aa36-9ff9a679c3e9 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1315 microversion: 2.1 time: 0.138572 Aug 19 09:29:16.633118 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 686/1345] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:16 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:17.246278 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-941af52f-339c-4002-987e-5dcdde940324 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:17.247404 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-941af52f-339c-4002-987e-5dcdde940324 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:17.253306 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-941af52f-339c-4002-987e-5dcdde940324 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.254310 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-941af52f-339c-4002-987e-5dcdde940324 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.255170 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-941af52f-339c-4002-987e-5dcdde940324 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.255632 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-941af52f-339c-4002-987e-5dcdde940324 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.284533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-941af52f-339c-4002-987e-5dcdde940324 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042266 Aug 19 09:29:17.288829 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-ac10df1e-721b-4bce-8a75-cd610728860b req-85306cd5-bb70-4dd0-976e-91c293e8e29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4188887-8ddf-4a67-9fd0-ba27eaa3da17", "name": "network-vif-plugged", "status": "completed", "tag": "71c5fc60-38d2-4300-82d8-c72a4afcc9da"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:29:17.290407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:29:17.290407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:29:17.291800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 660/1346] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:29:17 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:29:17.298488 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-ac10df1e-721b-4bce-8a75-cd610728860b req-85306cd5-bb70-4dd0-976e-91c293e8e29a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.299201 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-ac10df1e-721b-4bce-8a75-cd610728860b req-85306cd5-bb70-4dd0-976e-91c293e8e29a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.314257 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-ac10df1e-721b-4bce-8a75-cd610728860b req-85306cd5-bb70-4dd0-976e-91c293e8e29a service nova] Creating event network-vif-plugged:71c5fc60-38d2-4300-82d8-c72a4afcc9da for instance b4188887-8ddf-4a67-9fd0-ba27eaa3da17 on hv-cinder-77387 Aug 19 09:29:17.320054 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-ac10df1e-721b-4bce-8a75-cd610728860b req-85306cd5-bb70-4dd0-976e-91c293e8e29a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035730 Aug 19 09:29:17.320942 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 687/1347] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:29:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:17.408240 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7f9ec6db-4047-49ee-b387-b67eaeb68c5a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:17.409197 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7f9ec6db-4047-49ee-b387-b67eaeb68c5a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:17.416204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f9ec6db-4047-49ee-b387-b67eaeb68c5a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.416654 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f9ec6db-4047-49ee-b387-b67eaeb68c5a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.417421 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f9ec6db-4047-49ee-b387-b67eaeb68c5a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.417853 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7f9ec6db-4047-49ee-b387-b67eaeb68c5a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.448046 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7f9ec6db-4047-49ee-b387-b67eaeb68c5a tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043423 Aug 19 09:29:17.448617 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 661/1348] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:29:17 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:29:17.510793 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-74977f73-1889-48a9-b6b6-87f6e358c7c2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:17.511401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-74977f73-1889-48a9-b6b6-87f6e358c7c2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:17.517332 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74977f73-1889-48a9-b6b6-87f6e358c7c2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.517776 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74977f73-1889-48a9-b6b6-87f6e358c7c2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.518539 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74977f73-1889-48a9-b6b6-87f6e358c7c2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.518972 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74977f73-1889-48a9-b6b6-87f6e358c7c2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.544693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-74977f73-1889-48a9-b6b6-87f6e358c7c2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Going to try to terminate instance {{(pid=107957) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:29:17.618187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-74977f73-1889-48a9-b6b6-87f6e358c7c2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "DELETE /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 204 len: 0 microversion: 2.1 time: 0.111077 Aug 19 09:29:17.618745 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 688/1349] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:29:17 2021] DELETE /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:29:17.626751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8aeadab9-ade0-44d8-a1cd-b485f1713bb2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:17.627382 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8aeadab9-ade0-44d8-a1cd-b485f1713bb2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:17.633056 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8aeadab9-ade0-44d8-a1cd-b485f1713bb2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.633498 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8aeadab9-ade0-44d8-a1cd-b485f1713bb2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.634245 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8aeadab9-ade0-44d8-a1cd-b485f1713bb2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.634671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8aeadab9-ade0-44d8-a1cd-b485f1713bb2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.649346 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ae773ad2-b5a2-4fb5-ab38-f01d9659e81a tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:17.650073 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ae773ad2-b5a2-4fb5-ab38-f01d9659e81a tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:17.658886 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ae773ad2-b5a2-4fb5-ab38-f01d9659e81a tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.661284 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ae773ad2-b5a2-4fb5-ab38-f01d9659e81a tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.661481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ae773ad2-b5a2-4fb5-ab38-f01d9659e81a tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:17.661915 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ae773ad2-b5a2-4fb5-ab38-f01d9659e81a tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:17.786397 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ae773ad2-b5a2-4fb5-ab38-f01d9659e81a tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:17.793921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ae773ad2-b5a2-4fb5-ab38-f01d9659e81a tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1315 microversion: 2.1 time: 0.148437 Aug 19 09:29:17.794506 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 689/1350] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:17 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:18.010887 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8aeadab9-ade0-44d8-a1cd-b485f1713bb2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:18.018085 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8aeadab9-ade0-44d8-a1cd-b485f1713bb2 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1675 microversion: 2.1 time: 0.394989 Aug 19 09:29:18.018645 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 662/1351] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:17 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1675 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:18.809702 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0671d6c3-29bd-4e4c-b937-4378b78630fb tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:18.810231 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0671d6c3-29bd-4e4c-b937-4378b78630fb tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:18.815977 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0671d6c3-29bd-4e4c-b937-4378b78630fb tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:18.816415 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0671d6c3-29bd-4e4c-b937-4378b78630fb tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:18.817162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0671d6c3-29bd-4e4c-b937-4378b78630fb tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:18.817591 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0671d6c3-29bd-4e4c-b937-4378b78630fb tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:18.938320 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0671d6c3-29bd-4e4c-b937-4378b78630fb tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:18.946161 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0671d6c3-29bd-4e4c-b937-4378b78630fb tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1315 microversion: 2.1 time: 0.140167 Aug 19 09:29:18.946734 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 690/1352] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:18 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:19.036671 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9c4f8374-48f5-4c97-98c9-49880d88923c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:19.037276 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9c4f8374-48f5-4c97-98c9-49880d88923c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:19.042918 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c4f8374-48f5-4c97-98c9-49880d88923c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:19.043394 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c4f8374-48f5-4c97-98c9-49880d88923c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:19.044177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c4f8374-48f5-4c97-98c9-49880d88923c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:19.044628 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9c4f8374-48f5-4c97-98c9-49880d88923c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:19.162809 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9c4f8374-48f5-4c97-98c9-49880d88923c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:19.170082 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9c4f8374-48f5-4c97-98c9-49880d88923c tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1675 microversion: 2.1 time: 0.137693 Aug 19 09:29:19.170641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 663/1353] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:19 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1675 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:19.963172 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9fce98e6-e5aa-41da-8fa2-386ab8d756db tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:19.963784 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9fce98e6-e5aa-41da-8fa2-386ab8d756db tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:19.969387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9fce98e6-e5aa-41da-8fa2-386ab8d756db tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:19.969829 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9fce98e6-e5aa-41da-8fa2-386ab8d756db tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:19.970589 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9fce98e6-e5aa-41da-8fa2-386ab8d756db tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:19.971017 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9fce98e6-e5aa-41da-8fa2-386ab8d756db tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:20.090088 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-9fce98e6-e5aa-41da-8fa2-386ab8d756db tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:20.098037 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9fce98e6-e5aa-41da-8fa2-386ab8d756db tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1465 microversion: 2.1 time: 0.137744 Aug 19 09:29:20.098611 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 691/1354] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:19 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1465 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:20.133907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-dcb0968c-6fb7-4de9-bd15-37fdd37c33ce tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:20.134391 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-dcb0968c-6fb7-4de9-bd15-37fdd37c33ce tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:20.140077 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcb0968c-6fb7-4de9-bd15-37fdd37c33ce tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:20.140517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcb0968c-6fb7-4de9-bd15-37fdd37c33ce tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:20.141268 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcb0968c-6fb7-4de9-bd15-37fdd37c33ce tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:20.141691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-dcb0968c-6fb7-4de9-bd15-37fdd37c33ce tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:20.165642 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-dcb0968c-6fb7-4de9-bd15-37fdd37c33ce tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:29:20.187397 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3870036f-95b3-4b51-b879-e307aa3e7070 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:20.188002 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3870036f-95b3-4b51-b879-e307aa3e7070 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:20.194313 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3870036f-95b3-4b51-b879-e307aa3e7070 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:20.194824 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3870036f-95b3-4b51-b879-e307aa3e7070 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:20.195611 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3870036f-95b3-4b51-b879-e307aa3e7070 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:20.196037 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3870036f-95b3-4b51-b879-e307aa3e7070 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:20.243011 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-dcb0968c-6fb7-4de9-bd15-37fdd37c33ce tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 204 len: 0 microversion: 2.1 time: 0.112373 Aug 19 09:29:20.243640 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 664/1355] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:29:20 2021] DELETE /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:29:20.251659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-67e69f07-6465-4a8b-89e9-103b7f450e94 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:20.252360 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-67e69f07-6465-4a8b-89e9-103b7f450e94 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:20.258786 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67e69f07-6465-4a8b-89e9-103b7f450e94 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:20.259230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67e69f07-6465-4a8b-89e9-103b7f450e94 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:20.260029 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67e69f07-6465-4a8b-89e9-103b7f450e94 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:20.260462 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-67e69f07-6465-4a8b-89e9-103b7f450e94 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:20.319056 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3870036f-95b3-4b51-b879-e307aa3e7070 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:20.326384 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3870036f-95b3-4b51-b879-e307aa3e7070 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1675 microversion: 2.1 time: 0.142529 Aug 19 09:29:20.326959 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 692/1356] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:20 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1675 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:29:20.463726 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-67e69f07-6465-4a8b-89e9-103b7f450e94 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:20.470895 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-67e69f07-6465-4a8b-89e9-103b7f450e94 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1471 microversion: 2.1 time: 0.223011 Aug 19 09:29:20.471487 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 665/1357] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:20 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:21.153600 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-e5f296d4-6057-4dab-b500-c484a615a536 req-7a7e7b04-94dd-4d0b-86d2-f56835459b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "402d3979-28e9-446f-b50d-c5f17f340a4c", "name": "network-vif-deleted", "tag": "ba0255ca-86c6-4ef3-a366-9048b06a1e36"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:29:21.155178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:29:21.155178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:29:21.164087 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-e5f296d4-6057-4dab-b500-c484a615a536 req-7a7e7b04-94dd-4d0b-86d2-f56835459b7c service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:21.164478 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-e5f296d4-6057-4dab-b500-c484a615a536 req-7a7e7b04-94dd-4d0b-86d2-f56835459b7c service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:21.176907 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-e5f296d4-6057-4dab-b500-c484a615a536 req-7a7e7b04-94dd-4d0b-86d2-f56835459b7c service nova] Creating event network-vif-deleted:ba0255ca-86c6-4ef3-a366-9048b06a1e36 for instance 402d3979-28e9-446f-b50d-c5f17f340a4c on hv-cinder-77387 Aug 19 09:29:21.182097 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-e5f296d4-6057-4dab-b500-c484a615a536 req-7a7e7b04-94dd-4d0b-86d2-f56835459b7c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032542 Aug 19 09:29:21.182983 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 693/1358] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:29:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:21.344480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:21.345102 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:21.351716 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:21.352177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:21.352955 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:21.353394 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:21.396212 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:21.396944 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:21.397283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lazy-loading 'fault' on Instance uuid 402d3979-28e9-446f-b50d-c5f17f340a4c {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:29:21.436092 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4775744e6880427c8e91e67afe713052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19c107f773440eb8c2ab26706bc3591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:21.443512 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e0f575a4-f241-4ea2-81d1-ed4d0ba59783 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 200 len: 1328 microversion: 2.1 time: 0.102721 Aug 19 09:29:21.444065 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 666/1359] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:21 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:21.489405 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fe6e8209-db65-43d6-887b-62e16ac12cde tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:21.490057 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fe6e8209-db65-43d6-887b-62e16ac12cde tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:21.495957 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fe6e8209-db65-43d6-887b-62e16ac12cde tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:21.496403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fe6e8209-db65-43d6-887b-62e16ac12cde tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:21.497157 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fe6e8209-db65-43d6-887b-62e16ac12cde tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:21.497584 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fe6e8209-db65-43d6-887b-62e16ac12cde tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:21.622750 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fe6e8209-db65-43d6-887b-62e16ac12cde tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:21.630936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fe6e8209-db65-43d6-887b-62e16ac12cde tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1471 microversion: 2.1 time: 0.145587 Aug 19 09:29:21.631532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 694/1360] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:21 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:29:22.461392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4bb5e09e-82b4-4afa-9f77-37d228507235 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:22.462188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4bb5e09e-82b4-4afa-9f77-37d228507235 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:22.468121 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4bb5e09e-82b4-4afa-9f77-37d228507235 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:22.468570 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4bb5e09e-82b4-4afa-9f77-37d228507235 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:22.469548 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4bb5e09e-82b4-4afa-9f77-37d228507235 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:22.470037 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4bb5e09e-82b4-4afa-9f77-37d228507235 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:22.485419 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-4bb5e09e-82b4-4afa-9f77-37d228507235 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] HTTP exception thrown: Instance 402d3979-28e9-446f-b50d-c5f17f340a4c could not be found. Aug 19 09:29:22.486029 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4bb5e09e-82b4-4afa-9f77-37d228507235 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Returning 404 to user: Instance 402d3979-28e9-446f-b50d-c5f17f340a4c could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:29:22.486855 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4bb5e09e-82b4-4afa-9f77-37d228507235 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 404 len: 111 microversion: 2.1 time: 0.030053 Aug 19 09:29:22.487728 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 667/1361] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:22 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:29:22.495693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d53f5d2b-968f-4dcb-88fb-16b80e7ad666 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '.version_select at 0x7fdb804041f0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:22.514762 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d53f5d2b-968f-4dcb-88fb-16b80e7ad666 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754181333" status: 202 len: 0 microversion: 2.1 time: 0.022650 Aug 19 09:29:22.515367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 695/1362] 10.222.0.32 () {58 vars in 1221 bytes} [Thu Aug 19 09:29:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754181333 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 19 09:29:22.648808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:22.649533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:22.656008 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:22.656457 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:22.657231 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:22.657861 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:22.694300 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:22.694854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:22.695204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lazy-loading 'fault' on Instance uuid b4188887-8ddf-4a67-9fd0-ba27eaa3da17 {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:29:22.752292 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f40c8fa6fd64177b6b68a6fffa7549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecf484c1f8e4c35bd5bd99739db3cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:29:22.759664 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f4aabeb0-58a4-410d-b87a-df12359dc59e tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 200 len: 1305 microversion: 2.1 time: 0.115577 Aug 19 09:29:22.760224 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 668/1363] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:22 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 1305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:29:23.196509 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-982fa07a-68df-4cd4-9c1b-4c6312ba888b req-37d8f829-a1c8-411b-9bf6-549ee3446a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4188887-8ddf-4a67-9fd0-ba27eaa3da17", "name": "network-vif-deleted", "tag": "71c5fc60-38d2-4300-82d8-c72a4afcc9da"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:29:23.198013 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:29:23.198013 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:29:23.204679 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-982fa07a-68df-4cd4-9c1b-4c6312ba888b req-37d8f829-a1c8-411b-9bf6-549ee3446a8b service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:23.205115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-982fa07a-68df-4cd4-9c1b-4c6312ba888b req-37d8f829-a1c8-411b-9bf6-549ee3446a8b service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:23.216605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-982fa07a-68df-4cd4-9c1b-4c6312ba888b req-37d8f829-a1c8-411b-9bf6-549ee3446a8b service nova] Creating event network-vif-deleted:71c5fc60-38d2-4300-82d8-c72a4afcc9da for instance b4188887-8ddf-4a67-9fd0-ba27eaa3da17 on hv-cinder-77387 Aug 19 09:29:23.221455 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-982fa07a-68df-4cd4-9c1b-4c6312ba888b req-37d8f829-a1c8-411b-9bf6-549ee3446a8b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028443 Aug 19 09:29:23.222071 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 696/1364] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:29:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:23.777152 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e8feb2dd-f923-4027-819a-ee8806033c46 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:23.777688 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e8feb2dd-f923-4027-819a-ee8806033c46 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] [instance: b4188887-8ddf-4a67-9fd0-ba27eaa3da17] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:23.783856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e8feb2dd-f923-4027-819a-ee8806033c46 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:23.784309 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e8feb2dd-f923-4027-819a-ee8806033c46 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:23.785067 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e8feb2dd-f923-4027-819a-ee8806033c46 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:23.785513 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e8feb2dd-f923-4027-819a-ee8806033c46 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:23.798287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-e8feb2dd-f923-4027-819a-ee8806033c46 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] HTTP exception thrown: Instance b4188887-8ddf-4a67-9fd0-ba27eaa3da17 could not be found. Aug 19 09:29:23.798868 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e8feb2dd-f923-4027-819a-ee8806033c46 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] Returning 404 to user: Instance b4188887-8ddf-4a67-9fd0-ba27eaa3da17 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:29:23.799704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e8feb2dd-f923-4027-819a-ee8806033c46 tempest-VolumesNegativeTest-1884439412 tempest-VolumesNegativeTest-1884439412-project] 10.222.0.32 "GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17" status: 404 len: 111 microversion: 2.1 time: 0.026416 Aug 19 09:29:23.800221 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 669/1365] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:23 2021] GET /compute/v2.1/servers/b4188887-8ddf-4a67-9fd0-ba27eaa3da17 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:29:25.439704 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3a916182-8f53-4793-9ed6-d60e11942a81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:25.440293 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3a916182-8f53-4793-9ed6-d60e11942a81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:25.446919 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a916182-8f53-4793-9ed6-d60e11942a81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:25.447401 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a916182-8f53-4793-9ed6-d60e11942a81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:25.448167 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a916182-8f53-4793-9ed6-d60e11942a81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:25.448658 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3a916182-8f53-4793-9ed6-d60e11942a81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:25.462508 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-3a916182-8f53-4793-9ed6-d60e11942a81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] HTTP exception thrown: Instance 402d3979-28e9-446f-b50d-c5f17f340a4c could not be found. Aug 19 09:29:25.463100 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3a916182-8f53-4793-9ed6-d60e11942a81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Returning 404 to user: Instance 402d3979-28e9-446f-b50d-c5f17f340a4c could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:29:25.463948 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3a916182-8f53-4793-9ed6-d60e11942a81 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "DELETE /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 404 len: 111 microversion: 2.1 time: 0.028584 Aug 19 09:29:25.464481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 697/1366] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:29:25 2021] DELETE /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:29:25.472114 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-903d26d6-2cd6-4981-b0fe-a41ca68c85bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:25.473351 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-903d26d6-2cd6-4981-b0fe-a41ca68c85bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 402d3979-28e9-446f-b50d-c5f17f340a4c] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:25.479070 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-903d26d6-2cd6-4981-b0fe-a41ca68c85bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:25.479564 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-903d26d6-2cd6-4981-b0fe-a41ca68c85bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:25.480315 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-903d26d6-2cd6-4981-b0fe-a41ca68c85bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:25.480740 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-903d26d6-2cd6-4981-b0fe-a41ca68c85bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:25.493482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-903d26d6-2cd6-4981-b0fe-a41ca68c85bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] HTTP exception thrown: Instance 402d3979-28e9-446f-b50d-c5f17f340a4c could not be found. Aug 19 09:29:25.494058 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-903d26d6-2cd6-4981-b0fe-a41ca68c85bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Returning 404 to user: Instance 402d3979-28e9-446f-b50d-c5f17f340a4c could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:29:25.494861 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-903d26d6-2cd6-4981-b0fe-a41ca68c85bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c" status: 404 len: 111 microversion: 2.1 time: 0.026387 Aug 19 09:29:25.495424 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 670/1367] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:25 2021] GET /compute/v2.1/servers/402d3979-28e9-446f-b50d-c5f17f340a4c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:29:26.633651 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-da9e7d39-f562-492f-93f1-29b1a70532bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:26.634134 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-da9e7d39-f562-492f-93f1-29b1a70532bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:26.639881 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da9e7d39-f562-492f-93f1-29b1a70532bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:26.640325 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da9e7d39-f562-492f-93f1-29b1a70532bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:26.641070 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da9e7d39-f562-492f-93f1-29b1a70532bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:26.641500 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-da9e7d39-f562-492f-93f1-29b1a70532bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:26.654419 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-da9e7d39-f562-492f-93f1-29b1a70532bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] HTTP exception thrown: Instance 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 could not be found. Aug 19 09:29:26.654995 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-da9e7d39-f562-492f-93f1-29b1a70532bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Returning 404 to user: Instance 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:29:26.655927 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-da9e7d39-f562-492f-93f1-29b1a70532bb tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 404 len: 111 microversion: 2.1 time: 0.026403 Aug 19 09:29:26.659175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 698/1368] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:29:26 2021] DELETE /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:29:26.664052 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9940b2ad-7b32-430a-8f7a-92023eb4daf1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:26.664772 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9940b2ad-7b32-430a-8f7a-92023eb4daf1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] [instance: 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:29:26.670730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9940b2ad-7b32-430a-8f7a-92023eb4daf1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:26.671393 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9940b2ad-7b32-430a-8f7a-92023eb4daf1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:26.672263 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9940b2ad-7b32-430a-8f7a-92023eb4daf1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:29:26.672798 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9940b2ad-7b32-430a-8f7a-92023eb4daf1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:29:26.686789 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-9940b2ad-7b32-430a-8f7a-92023eb4daf1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] HTTP exception thrown: Instance 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 could not be found. Aug 19 09:29:26.687498 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9940b2ad-7b32-430a-8f7a-92023eb4daf1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] Returning 404 to user: Instance 7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:29:26.688391 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9940b2ad-7b32-430a-8f7a-92023eb4daf1 tempest-AttachVolumeTestJSON-63126090 tempest-AttachVolumeTestJSON-63126090-project] 10.222.0.32 "GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424" status: 404 len: 111 microversion: 2.1 time: 0.028042 Aug 19 09:29:26.689004 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 671/1369] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:29:26 2021] GET /compute/v2.1/servers/7d5ddc1c-4cb2-4bb3-a8c8-f0e061415424 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:29:31.317902 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-482068c1-8dd9-4fb0-b1be-52c688cf33ea tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] Action: 'create', calling method: .version_select at 0x7fdb803a9310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1300900654", "metadata": {"Type": "work"}}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:29:31.716047 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-482068c1-8dd9-4fb0-b1be-52c688cf33ea tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.526651 Aug 19 09:29:31.716679 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 699/1370] 10.222.0.32 () {60 vars in 1156 bytes} [Thu Aug 19 09:29:31 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 528 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 19 09:29:31.728772 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-a4167d35-1857-4b37-8a01-93627d39c2b8 tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] Calling method '.version_select at 0x7fdb8526e1f0>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:31.810124 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-a4167d35-1857-4b37-8a01-93627d39c2b8 tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566" status: 200 len: 353 microversion: 2.1 time: 0.084905 Aug 19 09:29:31.810683 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 672/1371] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:29:31 2021] GET /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:32.824232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-36e2bc87-26d7-4fff-9d8c-8143ecc0ee4a tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] Calling method '.version_select at 0x7fdb80c90c10>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:32.884782 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-36e2bc87-26d7-4fff-9d8c-8143ecc0ee4a tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566" status: 200 len: 354 microversion: 2.1 time: 0.064079 Aug 19 09:29:32.885503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 700/1372] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:29:32 2021] GET /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566 => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:32.896248 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-fe1c5837-195a-487f-a937-6abc4d2cecc7 tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] Calling method '.version_select at 0x7fdb8526ddc0>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:32.949489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-fe1c5837-195a-487f-a937-6abc4d2cecc7 tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566" status: 200 len: 354 microversion: 2.1 time: 0.056972 Aug 19 09:29:32.950058 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 673/1373] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:29:32 2021] GET /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:32.966005 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-97f26315-a310-4874-b476-973fd758fa5e tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] Calling method '.version_select at 0x7fdb803cc310>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:33.066585 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-97f26315-a310-4874-b476-973fd758fa5e tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566" status: 202 len: 0 microversion: 2.1 time: 0.104024 Aug 19 09:29:33.067206 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 701/1374] 10.222.0.32 () {58 vars in 1248 bytes} [Thu Aug 19 09:29:32 2021] DELETE /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:29:33.075928 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-86dd98a5-e4c7-481d-ab21-10e0723c2eea tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] Calling method '.version_select at 0x7fdb852c2670>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:33.139104 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-86dd98a5-e4c7-481d-ab21-10e0723c2eea tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566" status: 200 len: 353 microversion: 2.1 time: 0.067568 Aug 19 09:29:33.139704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 674/1375] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:29:33 2021] GET /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:29:34.152389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b69f1eaa-6436-4e02-9a3c-2a6b3f49bc73 tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] Calling method '.version_select at 0x7fdb80c903a0>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:29:34.186865 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-b69f1eaa-6436-4e02-9a3c-2a6b3f49bc73 tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] HTTP exception thrown: Volume 910719be-5033-49de-971c-03eee96b3566 could not be found. Aug 19 09:29:34.187681 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b69f1eaa-6436-4e02-9a3c-2a6b3f49bc73 tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] Returning 404 to user: Volume 910719be-5033-49de-971c-03eee96b3566 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:29:34.188583 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b69f1eaa-6436-4e02-9a3c-2a6b3f49bc73 tempest-VolumesGetTestJSON-89387465 tempest-VolumesGetTestJSON-89387465-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566" status: 404 len: 109 microversion: 2.1 time: 0.040044 Aug 19 09:29:34.189198 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 702/1376] 10.222.0.32 () {58 vars in 1245 bytes} [Thu Aug 19 09:29:34 2021] GET /compute/v2.1/os-volumes/910719be-5033-49de-971c-03eee96b3566 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:29:38.762218 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9aa13a67-87a9-44fa-a10e-9324aa621408 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Action: 'create', calling method: .version_select at 0x7fdb852c2b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1751414454"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:29:38.781377 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-9aa13a67-87a9-44fa-a10e-9324aa621408 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Getting quotas for project 06f1ca56a68b40f693d7f41d1f8646d9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:29:38.787481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-9aa13a67-87a9-44fa-a10e-9324aa621408 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Getting quotas for user fa90df3873954392a91682d8470e25e8 and project 06f1ca56a68b40f693d7f41d1f8646d9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:29:39.079056 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-9aa13a67-87a9-44fa-a10e-9324aa621408 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Getting quotas for project 06f1ca56a68b40f693d7f41d1f8646d9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:29:39.083054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-9aa13a67-87a9-44fa-a10e-9324aa621408 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Getting quotas for user fa90df3873954392a91682d8470e25e8 and project 06f1ca56a68b40f693d7f41d1f8646d9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:29:39.096725 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9aa13a67-87a9-44fa-a10e-9324aa621408 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.565396 Aug 19 09:29:39.097817 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 675/1377] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Aug 19 09:29:38 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:04.956182 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1303562760", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1751414454", "security_groups": [{"name": "tempest-secgroup-smoke-409313387"}], "networks": [{"uuid": "016591c5-c729-4b00-8d4b-0a7b38936a0c"}], "block_device_mapping_v2": [{"uuid": "550d3cbb-535c-4705-9272-dc55cf0641c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:05.088190 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.network.neutron [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] validate_networks() for [('016591c5-c729-4b00-8d4b-0a7b38936a0c', None, None, None, None, None)] {{(pid=107957) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:30:05.519632 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Flavor limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:30:05.520336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Image limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:30:05.520805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Flavor pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:30:05.521209 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Image pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:30:05.521615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:30:05.530945 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:05.531421 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:05.532216 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:05.532641 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:05.553329 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Getting quotas for project 06f1ca56a68b40f693d7f41d1f8646d9. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:30:05.558861 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Getting quotas for user fa90df3873954392a91682d8470e25e8 and project 06f1ca56a68b40f693d7f41d1f8646d9. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:30:05.643428 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Going to run 1 instances... {{(pid=107957) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:30:05.646061 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='550d3cbb-535c-4705-9272-dc55cf0641c3',volume_size=None,volume_type=None)] {{(pid=107957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:30:05.854132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-44c6cf8d-a57f-4059-b125-16f455efe957 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.901391 Aug 19 09:30:05.856390 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 703/1378] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:30:04 2021] POST /compute/v2.1/servers => generated 405 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:30:05.865740 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7c43d604-26da-46bb-9c53-8abf8f1eedee tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:05.866497 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7c43d604-26da-46bb-9c53-8abf8f1eedee tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:05.971691 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7c43d604-26da-46bb-9c53-8abf8f1eedee tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:05.989390 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7c43d604-26da-46bb-9c53-8abf8f1eedee tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1089 microversion: 2.1 time: 0.128087 Aug 19 09:30:06.002570 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 676/1379] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:05 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1089 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:07.008908 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-320a6fcd-ca05-4dc6-a911-0f5da03e10e7 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:07.010412 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-320a6fcd-ca05-4dc6-a911-0f5da03e10e7 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:07.022192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-320a6fcd-ca05-4dc6-a911-0f5da03e10e7 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:07.023858 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-320a6fcd-ca05-4dc6-a911-0f5da03e10e7 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:07.024949 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-320a6fcd-ca05-4dc6-a911-0f5da03e10e7 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:07.025811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-320a6fcd-ca05-4dc6-a911-0f5da03e10e7 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:07.118474 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-320a6fcd-ca05-4dc6-a911-0f5da03e10e7 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:07.126375 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-320a6fcd-ca05-4dc6-a911-0f5da03e10e7 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1195 microversion: 2.1 time: 0.121495 Aug 19 09:30:07.135298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 704/1380] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:07 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1195 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:08.144495 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7b492ba4-c51f-4558-8d3c-d2de39ee117c tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:08.145118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7b492ba4-c51f-4558-8d3c-d2de39ee117c tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:08.153225 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b492ba4-c51f-4558-8d3c-d2de39ee117c tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:08.154191 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b492ba4-c51f-4558-8d3c-d2de39ee117c tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:08.157631 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b492ba4-c51f-4558-8d3c-d2de39ee117c tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:08.158266 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7b492ba4-c51f-4558-8d3c-d2de39ee117c tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:08.657826 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7b492ba4-c51f-4558-8d3c-d2de39ee117c tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:08.677771 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7b492ba4-c51f-4558-8d3c-d2de39ee117c tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1193 microversion: 2.1 time: 0.537239 Aug 19 09:30:08.679042 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 677/1381] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:08 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1193 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:09.705039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b8f6e698-0691-4754-991f-5e3ba1284de1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:09.706294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b8f6e698-0691-4754-991f-5e3ba1284de1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:09.715817 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b8f6e698-0691-4754-991f-5e3ba1284de1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:09.717847 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b8f6e698-0691-4754-991f-5e3ba1284de1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:09.719175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b8f6e698-0691-4754-991f-5e3ba1284de1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:09.720163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b8f6e698-0691-4754-991f-5e3ba1284de1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:09.876398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b8f6e698-0691-4754-991f-5e3ba1284de1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:09.887807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b8f6e698-0691-4754-991f-5e3ba1284de1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.195871 Aug 19 09:30:09.888382 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 705/1382] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:09 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:10.261424 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-09129b19-6122-48e6-af5e-232a0c44ff14 req-98db402c-67ff-4964-8a50-0acdea5b3c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28718e64-45fc-43ba-8132-a59e7a0dbf86", "tag": "ef99c2b3-920f-4e54-9c11-002a92166219"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:10.263928 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:30:10.263928 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:30:10.272121 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-09129b19-6122-48e6-af5e-232a0c44ff14 req-98db402c-67ff-4964-8a50-0acdea5b3c09 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:10.272925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-09129b19-6122-48e6-af5e-232a0c44ff14 req-98db402c-67ff-4964-8a50-0acdea5b3c09 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:10.288831 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-09129b19-6122-48e6-af5e-232a0c44ff14 req-98db402c-67ff-4964-8a50-0acdea5b3c09 service nova] Creating event network-changed:ef99c2b3-920f-4e54-9c11-002a92166219 for instance 28718e64-45fc-43ba-8132-a59e7a0dbf86 on hv-cinder-77387 Aug 19 09:30:10.300845 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-09129b19-6122-48e6-af5e-232a0c44ff14 req-98db402c-67ff-4964-8a50-0acdea5b3c09 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043086 Aug 19 09:30:10.302042 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 678/1383] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:30:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:30:10.905410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-44e91c39-f811-4c0f-b1a7-7c69e98f046e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:10.906023 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-44e91c39-f811-4c0f-b1a7-7c69e98f046e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:10.912115 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44e91c39-f811-4c0f-b1a7-7c69e98f046e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:10.913199 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44e91c39-f811-4c0f-b1a7-7c69e98f046e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:10.914805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44e91c39-f811-4c0f-b1a7-7c69e98f046e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:10.915433 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-44e91c39-f811-4c0f-b1a7-7c69e98f046e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:11.074299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-44e91c39-f811-4c0f-b1a7-7c69e98f046e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:11.084556 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-44e91c39-f811-4c0f-b1a7-7c69e98f046e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.182690 Aug 19 09:30:11.095659 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 706/1384] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:10 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:12.108667 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-fd9bf74c-d0b4-4881-908d-af40f8264caa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:12.110886 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-fd9bf74c-d0b4-4881-908d-af40f8264caa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:12.122272 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fd9bf74c-d0b4-4881-908d-af40f8264caa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:12.122974 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fd9bf74c-d0b4-4881-908d-af40f8264caa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:12.127018 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fd9bf74c-d0b4-4881-908d-af40f8264caa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:12.128087 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-fd9bf74c-d0b4-4881-908d-af40f8264caa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:12.385882 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-fd9bf74c-d0b4-4881-908d-af40f8264caa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:12.394283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-fd9bf74c-d0b4-4881-908d-af40f8264caa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.293387 Aug 19 09:30:12.395186 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 679/1385] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:12 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:13.410202 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a409d927-dd84-4c6a-b583-f757d1cd1d97 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:13.410803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a409d927-dd84-4c6a-b583-f757d1cd1d97 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:13.424015 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a409d927-dd84-4c6a-b583-f757d1cd1d97 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:13.424481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a409d927-dd84-4c6a-b583-f757d1cd1d97 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:13.425288 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a409d927-dd84-4c6a-b583-f757d1cd1d97 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:13.425697 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a409d927-dd84-4c6a-b583-f757d1cd1d97 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:13.582685 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a409d927-dd84-4c6a-b583-f757d1cd1d97 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:13.592562 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a409d927-dd84-4c6a-b583-f757d1cd1d97 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.185758 Aug 19 09:30:13.603933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 707/1386] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:13 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:14.609636 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9d45c382-7af4-4224-8d24-11c6288e683f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:14.610907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9d45c382-7af4-4224-8d24-11c6288e683f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:14.620481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d45c382-7af4-4224-8d24-11c6288e683f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:14.622968 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d45c382-7af4-4224-8d24-11c6288e683f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:14.625129 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d45c382-7af4-4224-8d24-11c6288e683f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:14.626617 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9d45c382-7af4-4224-8d24-11c6288e683f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:14.843262 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9d45c382-7af4-4224-8d24-11c6288e683f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:14.856612 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9d45c382-7af4-4224-8d24-11c6288e683f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.250497 Aug 19 09:30:14.857769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 680/1387] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:14 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:15.875552 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-700b8587-1daa-4e3a-aedb-f0f99035258a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:15.876164 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-700b8587-1daa-4e3a-aedb-f0f99035258a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:15.885122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-700b8587-1daa-4e3a-aedb-f0f99035258a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:15.885577 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-700b8587-1daa-4e3a-aedb-f0f99035258a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:15.886429 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-700b8587-1daa-4e3a-aedb-f0f99035258a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:15.894877 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-700b8587-1daa-4e3a-aedb-f0f99035258a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:16.055995 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-700b8587-1daa-4e3a-aedb-f0f99035258a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:16.064386 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-700b8587-1daa-4e3a-aedb-f0f99035258a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.194305 Aug 19 09:30:16.065831 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 708/1388] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:15 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:17.081828 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-725ee751-8ba7-4655-9244-9a301b8c95ef tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:17.082435 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-725ee751-8ba7-4655-9244-9a301b8c95ef tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:17.089553 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-725ee751-8ba7-4655-9244-9a301b8c95ef tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:17.090501 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-725ee751-8ba7-4655-9244-9a301b8c95ef tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:17.091580 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-725ee751-8ba7-4655-9244-9a301b8c95ef tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:17.092177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-725ee751-8ba7-4655-9244-9a301b8c95ef tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:17.227996 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-725ee751-8ba7-4655-9244-9a301b8c95ef tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:17.235524 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-725ee751-8ba7-4655-9244-9a301b8c95ef tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.157298 Aug 19 09:30:17.236175 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 681/1389] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:17 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:18.251571 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f6bd1a70-557f-4df8-b055-9cf0b2db4177 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:18.252942 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f6bd1a70-557f-4df8-b055-9cf0b2db4177 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:18.259713 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f6bd1a70-557f-4df8-b055-9cf0b2db4177 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:18.260228 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f6bd1a70-557f-4df8-b055-9cf0b2db4177 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:18.261223 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f6bd1a70-557f-4df8-b055-9cf0b2db4177 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:18.261651 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f6bd1a70-557f-4df8-b055-9cf0b2db4177 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:18.406936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f6bd1a70-557f-4df8-b055-9cf0b2db4177 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:18.414815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f6bd1a70-557f-4df8-b055-9cf0b2db4177 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.166852 Aug 19 09:30:18.424221 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 709/1390] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:18 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:19.431697 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-24e9ab45-49a2-41b2-bb49-8885ea7b0b8e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:19.433069 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-24e9ab45-49a2-41b2-bb49-8885ea7b0b8e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:19.448369 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24e9ab45-49a2-41b2-bb49-8885ea7b0b8e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:19.449154 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24e9ab45-49a2-41b2-bb49-8885ea7b0b8e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:19.450247 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24e9ab45-49a2-41b2-bb49-8885ea7b0b8e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:19.450875 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-24e9ab45-49a2-41b2-bb49-8885ea7b0b8e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:19.594497 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-24e9ab45-49a2-41b2-bb49-8885ea7b0b8e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:19.602864 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-24e9ab45-49a2-41b2-bb49-8885ea7b0b8e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.175605 Aug 19 09:30:19.604440 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 682/1391] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:19 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:20.620261 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f206650f-df08-4e00-89b0-7ee9aa683389 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:20.621131 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f206650f-df08-4e00-89b0-7ee9aa683389 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:20.627125 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f206650f-df08-4e00-89b0-7ee9aa683389 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:20.627629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f206650f-df08-4e00-89b0-7ee9aa683389 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:20.628392 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f206650f-df08-4e00-89b0-7ee9aa683389 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:20.629004 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f206650f-df08-4e00-89b0-7ee9aa683389 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:20.760914 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f206650f-df08-4e00-89b0-7ee9aa683389 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:20.769437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f206650f-df08-4e00-89b0-7ee9aa683389 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.153379 Aug 19 09:30:20.770003 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 710/1392] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:20 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:21.785734 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-88fe060f-33ed-4249-b0bd-314f8910e887 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:21.786429 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-88fe060f-33ed-4249-b0bd-314f8910e887 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:21.792752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-88fe060f-33ed-4249-b0bd-314f8910e887 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:21.795632 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-88fe060f-33ed-4249-b0bd-314f8910e887 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:21.796660 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-88fe060f-33ed-4249-b0bd-314f8910e887 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:21.798622 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-88fe060f-33ed-4249-b0bd-314f8910e887 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:21.849260 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-9da830d2-1929-4f59-9cb9-b85376500ecd req-a8470dd3-775a-4c79-ba69-118686d6d2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28718e64-45fc-43ba-8132-a59e7a0dbf86", "name": "network-vif-plugged", "status": "completed", "tag": "ef99c2b3-920f-4e54-9c11-002a92166219"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:21.851205 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:30:21.851205 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:30:21.858261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-9da830d2-1929-4f59-9cb9-b85376500ecd req-a8470dd3-775a-4c79-ba69-118686d6d2b2 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:21.858700 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-9da830d2-1929-4f59-9cb9-b85376500ecd req-a8470dd3-775a-4c79-ba69-118686d6d2b2 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:21.870855 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-9da830d2-1929-4f59-9cb9-b85376500ecd req-a8470dd3-775a-4c79-ba69-118686d6d2b2 service nova] Creating event network-vif-plugged:ef99c2b3-920f-4e54-9c11-002a92166219 for instance 28718e64-45fc-43ba-8132-a59e7a0dbf86 on hv-cinder-77387 Aug 19 09:30:21.876129 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-9da830d2-1929-4f59-9cb9-b85376500ecd req-a8470dd3-775a-4c79-ba69-118686d6d2b2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239820 Aug 19 09:30:21.880483 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 683/1393] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:30:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:30:21.943214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-88fe060f-33ed-4249-b0bd-314f8910e887 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:21.951445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-88fe060f-33ed-4249-b0bd-314f8910e887 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.169159 Aug 19 09:30:21.961807 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 711/1394] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:21 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:30:22.271380 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bd4f243b-f4e5-43ce-9621-ca06b74cc3e8 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Action: 'create', calling method: .version_select at 0x7fdb852600d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1168471457"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:22.289073 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-bd4f243b-f4e5-43ce-9621-ca06b74cc3e8 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Getting quotas for project 90530af20b71443db439806c0549e1c9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:30:22.292776 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-bd4f243b-f4e5-43ce-9621-ca06b74cc3e8 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Getting quotas for user ecb9d7220b6d4025b59129ec0323faf6 and project 90530af20b71443db439806c0549e1c9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:30:22.430403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-bd4f243b-f4e5-43ce-9621-ca06b74cc3e8 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Getting quotas for project 90530af20b71443db439806c0549e1c9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:30:22.433935 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-bd4f243b-f4e5-43ce-9621-ca06b74cc3e8 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Getting quotas for user ecb9d7220b6d4025b59129ec0323faf6 and project 90530af20b71443db439806c0549e1c9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:30:22.446751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bd4f243b-f4e5-43ce-9621-ca06b74cc3e8 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.179358 Aug 19 09:30:22.447354 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 684/1395] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Aug 19 09:30:22 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:22.495692 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-621244570", "imageRef": "4197c293-e0cc-493d-ae3a-c14559d95a2b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1168471457", "networks": [{"uuid": "17c70e32-3ff9-46f5-ae82-7db95896fdf5"}]}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:22.544121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.network.neutron [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] validate_networks() for [('17c70e32-3ff9-46f5-ae82-7db95896fdf5', None, None, None, None, None)] {{(pid=107957) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:30:22.905330 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Flavor limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:30:22.905813 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Image limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:30:22.906220 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Flavor pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:30:22.906619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Image pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:30:22.907021 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:30:22.916100 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:22.916535 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:22.917319 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:22.917747 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:22.934543 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Getting quotas for project 90530af20b71443db439806c0549e1c9. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:30:22.938176 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Getting quotas for user ecb9d7220b6d4025b59129ec0323faf6 and project 90530af20b71443db439806c0549e1c9. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:30:22.948474 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Going to run 1 instances... {{(pid=107957) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:30:22.950468 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4197c293-e0cc-493d-ae3a-c14559d95a2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:30:22.968791 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c9b2b85b-672d-4c0f-b9bf-80819802a8a9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:22.969606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c9b2b85b-672d-4c0f-b9bf-80819802a8a9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:22.976453 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c9b2b85b-672d-4c0f-b9bf-80819802a8a9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:22.976896 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c9b2b85b-672d-4c0f-b9bf-80819802a8a9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:22.977727 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c9b2b85b-672d-4c0f-b9bf-80819802a8a9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:22.978633 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c9b2b85b-672d-4c0f-b9bf-80819802a8a9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:22.997403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-418de3c8-9d16-44a8-a979-65e346ba87c5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504148 Aug 19 09:30:22.997630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 712/1396] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:30:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:30:23.006580 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6e847736-1f90-4bf0-8ece-31f7dc290aea tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:23.007738 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6e847736-1f90-4bf0-8ece-31f7dc290aea tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:23.066481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6e847736-1f90-4bf0-8ece-31f7dc290aea tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:23.074720 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6e847736-1f90-4bf0-8ece-31f7dc290aea tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1258 microversion: 2.1 time: 0.071719 Aug 19 09:30:23.075493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 713/1397] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:23 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:23.117407 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c9b2b85b-672d-4c0f-b9bf-80819802a8a9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:23.124881 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c9b2b85b-672d-4c0f-b9bf-80819802a8a9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1260 microversion: 2.1 time: 0.159794 Aug 19 09:30:23.125951 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 685/1398] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:22 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:24.092769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3c1f047e-8196-43dc-9e18-d8328a63f670 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:24.094137 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3c1f047e-8196-43dc-9e18-d8328a63f670 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:24.105284 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c1f047e-8196-43dc-9e18-d8328a63f670 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:24.105787 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c1f047e-8196-43dc-9e18-d8328a63f670 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:24.106972 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c1f047e-8196-43dc-9e18-d8328a63f670 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:24.108207 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3c1f047e-8196-43dc-9e18-d8328a63f670 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:24.141987 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c98ba0d3-13a9-41f6-955b-10c4836a3861 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:24.145392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c98ba0d3-13a9-41f6-955b-10c4836a3861 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:24.162652 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c98ba0d3-13a9-41f6-955b-10c4836a3861 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:24.165468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c98ba0d3-13a9-41f6-955b-10c4836a3861 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:24.166325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c98ba0d3-13a9-41f6-955b-10c4836a3861 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:24.166960 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c98ba0d3-13a9-41f6-955b-10c4836a3861 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:24.190178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-3c1f047e-8196-43dc-9e18-d8328a63f670 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:24.199796 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3c1f047e-8196-43dc-9e18-d8328a63f670 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1318 microversion: 2.1 time: 0.111048 Aug 19 09:30:24.200979 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 714/1399] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:24 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:24.384425 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c98ba0d3-13a9-41f6-955b-10c4836a3861 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:24.391469 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c98ba0d3-13a9-41f6-955b-10c4836a3861 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1444 microversion: 2.1 time: 0.253044 Aug 19 09:30:24.394151 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 686/1400] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:24 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1444 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:24.408352 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-61ba3148-8416-4df4-8bfb-b19ae86ea0e1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:24.409214 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-61ba3148-8416-4df4-8bfb-b19ae86ea0e1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:24.415968 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61ba3148-8416-4df4-8bfb-b19ae86ea0e1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:24.416666 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61ba3148-8416-4df4-8bfb-b19ae86ea0e1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:24.417645 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61ba3148-8416-4df4-8bfb-b19ae86ea0e1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:24.418165 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-61ba3148-8416-4df4-8bfb-b19ae86ea0e1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:24.560113 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-61ba3148-8416-4df4-8bfb-b19ae86ea0e1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:24.568472 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-61ba3148-8416-4df4-8bfb-b19ae86ea0e1 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1444 microversion: 2.1 time: 0.163789 Aug 19 09:30:24.569084 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 715/1401] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:24 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:30:25.217567 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-44512870-83ef-4b1e-b9c7-484c8ab164d7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:25.218876 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-44512870-83ef-4b1e-b9c7-484c8ab164d7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:25.225472 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-44512870-83ef-4b1e-b9c7-484c8ab164d7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:25.226969 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-44512870-83ef-4b1e-b9c7-484c8ab164d7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:25.228539 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-44512870-83ef-4b1e-b9c7-484c8ab164d7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:25.229203 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-44512870-83ef-4b1e-b9c7-484c8ab164d7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:25.467202 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-44512870-83ef-4b1e-b9c7-484c8ab164d7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:25.477799 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-44512870-83ef-4b1e-b9c7-484c8ab164d7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.263463 Aug 19 09:30:25.478312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 687/1402] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:25 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:26.494200 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-bc4e9182-5a43-4d1a-8824-52bfd22abbc6 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:26.494815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-bc4e9182-5a43-4d1a-8824-52bfd22abbc6 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:26.502082 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bc4e9182-5a43-4d1a-8824-52bfd22abbc6 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:26.503021 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bc4e9182-5a43-4d1a-8824-52bfd22abbc6 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:26.505467 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bc4e9182-5a43-4d1a-8824-52bfd22abbc6 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:26.506078 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-bc4e9182-5a43-4d1a-8824-52bfd22abbc6 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:26.643186 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-bc4e9182-5a43-4d1a-8824-52bfd22abbc6 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:26.652325 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-bc4e9182-5a43-4d1a-8824-52bfd22abbc6 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.162059 Aug 19 09:30:26.655322 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 716/1403] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:26 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:26.792219 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-764ad95a-e225-43b6-81d3-17b1caa2af6c req-6fd1a714-708e-4be5-a392-4ca5e4f81341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28718e64-45fc-43ba-8132-a59e7a0dbf86", "tag": "ef99c2b3-920f-4e54-9c11-002a92166219"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:26.794399 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:30:26.794399 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:30:26.801930 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-764ad95a-e225-43b6-81d3-17b1caa2af6c req-6fd1a714-708e-4be5-a392-4ca5e4f81341 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:26.802376 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-764ad95a-e225-43b6-81d3-17b1caa2af6c req-6fd1a714-708e-4be5-a392-4ca5e4f81341 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:26.816117 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-764ad95a-e225-43b6-81d3-17b1caa2af6c req-6fd1a714-708e-4be5-a392-4ca5e4f81341 service nova] Creating event network-changed:ef99c2b3-920f-4e54-9c11-002a92166219 for instance 28718e64-45fc-43ba-8132-a59e7a0dbf86 on hv-cinder-77387 Aug 19 09:30:26.821903 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-764ad95a-e225-43b6-81d3-17b1caa2af6c req-6fd1a714-708e-4be5-a392-4ca5e4f81341 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033734 Aug 19 09:30:26.822547 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 688/1404] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:30:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:30:27.673324 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c6afb998-402a-47b4-917a-fc5d1e4c6512 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:27.674689 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c6afb998-402a-47b4-917a-fc5d1e4c6512 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:27.681059 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c6afb998-402a-47b4-917a-fc5d1e4c6512 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:27.681749 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c6afb998-402a-47b4-917a-fc5d1e4c6512 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:27.682686 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c6afb998-402a-47b4-917a-fc5d1e4c6512 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:27.683309 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c6afb998-402a-47b4-917a-fc5d1e4c6512 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:27.818452 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c6afb998-402a-47b4-917a-fc5d1e4c6512 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:27.827141 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c6afb998-402a-47b4-917a-fc5d1e4c6512 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.161407 Aug 19 09:30:27.830816 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 717/1405] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:27 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:28.848267 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4eb801f5-5135-4675-b127-eaead60e1ad4 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:28.848898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4eb801f5-5135-4675-b127-eaead60e1ad4 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:28.855826 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4eb801f5-5135-4675-b127-eaead60e1ad4 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:28.856270 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4eb801f5-5135-4675-b127-eaead60e1ad4 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:28.857037 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4eb801f5-5135-4675-b127-eaead60e1ad4 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:28.857467 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4eb801f5-5135-4675-b127-eaead60e1ad4 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:28.984212 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4eb801f5-5135-4675-b127-eaead60e1ad4 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:28.992582 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4eb801f5-5135-4675-b127-eaead60e1ad4 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.147534 Aug 19 09:30:28.993170 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 689/1406] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:28 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:30.010029 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b796fc25-74e7-4f54-a13f-635cb55848c7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:30.011866 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b796fc25-74e7-4f54-a13f-635cb55848c7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:30.018478 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b796fc25-74e7-4f54-a13f-635cb55848c7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:30.019119 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b796fc25-74e7-4f54-a13f-635cb55848c7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:30.020039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b796fc25-74e7-4f54-a13f-635cb55848c7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:30.020576 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b796fc25-74e7-4f54-a13f-635cb55848c7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:30.160470 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b796fc25-74e7-4f54-a13f-635cb55848c7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:30.169943 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b796fc25-74e7-4f54-a13f-635cb55848c7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.163932 Aug 19 09:30:30.170744 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 718/1407] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:30 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:31.187536 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-02d707b2-365c-477a-83ed-26a831a53a51 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:31.188168 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-02d707b2-365c-477a-83ed-26a831a53a51 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:31.194276 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-02d707b2-365c-477a-83ed-26a831a53a51 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:31.195549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-02d707b2-365c-477a-83ed-26a831a53a51 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:31.196204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-02d707b2-365c-477a-83ed-26a831a53a51 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:31.196641 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-02d707b2-365c-477a-83ed-26a831a53a51 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:31.374486 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-02d707b2-365c-477a-83ed-26a831a53a51 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:31.383974 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-02d707b2-365c-477a-83ed-26a831a53a51 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.200204 Aug 19 09:30:31.384550 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 690/1408] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:31 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:30:32.400801 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ad307ab3-63ef-4595-a61a-5a0f41c29f60 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:32.401403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ad307ab3-63ef-4595-a61a-5a0f41c29f60 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:32.407574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ad307ab3-63ef-4595-a61a-5a0f41c29f60 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:32.409830 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ad307ab3-63ef-4595-a61a-5a0f41c29f60 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:32.410603 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ad307ab3-63ef-4595-a61a-5a0f41c29f60 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:32.411034 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ad307ab3-63ef-4595-a61a-5a0f41c29f60 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:32.549456 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ad307ab3-63ef-4595-a61a-5a0f41c29f60 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:32.562060 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ad307ab3-63ef-4595-a61a-5a0f41c29f60 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.164859 Aug 19 09:30:32.563670 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 719/1409] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:32 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:33.580345 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2c9ef323-daa9-439d-b262-dffdafc21a85 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:33.581346 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2c9ef323-daa9-439d-b262-dffdafc21a85 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:33.590047 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2c9ef323-daa9-439d-b262-dffdafc21a85 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:33.590493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2c9ef323-daa9-439d-b262-dffdafc21a85 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:33.591287 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2c9ef323-daa9-439d-b262-dffdafc21a85 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:33.591914 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2c9ef323-daa9-439d-b262-dffdafc21a85 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:33.980873 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2c9ef323-daa9-439d-b262-dffdafc21a85 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:33.988415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2c9ef323-daa9-439d-b262-dffdafc21a85 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.411838 Aug 19 09:30:33.991915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 691/1410] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:33 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:35.009967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-70aed986-a1c8-4c83-a633-e6f7ff7b3cde tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:35.010579 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-70aed986-a1c8-4c83-a633-e6f7ff7b3cde tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:35.016509 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70aed986-a1c8-4c83-a633-e6f7ff7b3cde tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:35.016953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70aed986-a1c8-4c83-a633-e6f7ff7b3cde tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:35.017733 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70aed986-a1c8-4c83-a633-e6f7ff7b3cde tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:35.018148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-70aed986-a1c8-4c83-a633-e6f7ff7b3cde tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:35.139776 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-70aed986-a1c8-4c83-a633-e6f7ff7b3cde tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:35.146924 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-70aed986-a1c8-4c83-a633-e6f7ff7b3cde tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.140882 Aug 19 09:30:35.147511 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 720/1411] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:35 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:36.163179 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-27220bce-91a1-422e-a538-5ae28eadefb5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:36.163839 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-27220bce-91a1-422e-a538-5ae28eadefb5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:36.169724 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-27220bce-91a1-422e-a538-5ae28eadefb5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:36.170174 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-27220bce-91a1-422e-a538-5ae28eadefb5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:36.170934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-27220bce-91a1-422e-a538-5ae28eadefb5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:36.171458 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-27220bce-91a1-422e-a538-5ae28eadefb5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:36.294448 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-27220bce-91a1-422e-a538-5ae28eadefb5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:36.301714 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-27220bce-91a1-422e-a538-5ae28eadefb5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.142238 Aug 19 09:30:36.302268 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 692/1412] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:36 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:37.317745 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c2d806df-2012-4f55-94b1-63dd31c124f3 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:37.318275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c2d806df-2012-4f55-94b1-63dd31c124f3 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:37.325168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2d806df-2012-4f55-94b1-63dd31c124f3 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:37.325625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2d806df-2012-4f55-94b1-63dd31c124f3 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:37.326424 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2d806df-2012-4f55-94b1-63dd31c124f3 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:37.326830 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c2d806df-2012-4f55-94b1-63dd31c124f3 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:37.453365 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c2d806df-2012-4f55-94b1-63dd31c124f3 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:37.460938 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c2d806df-2012-4f55-94b1-63dd31c124f3 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.146899 Aug 19 09:30:37.461699 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 721/1413] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:37 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:38.251932 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-390c457b-c040-433b-b17f-fa0c0a082aea req-05029673-9a65-4c5d-b22f-597f6a36536c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ceaf8b9-1f54-4411-87e3-c5153b26aff5", "tag": "a1947c9b-406d-42f3-b1df-9498363d4e6e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:38.254338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:30:38.254338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:30:38.262723 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-390c457b-c040-433b-b17f-fa0c0a082aea req-05029673-9a65-4c5d-b22f-597f6a36536c service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:38.263533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-390c457b-c040-433b-b17f-fa0c0a082aea req-05029673-9a65-4c5d-b22f-597f6a36536c service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:38.279957 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-390c457b-c040-433b-b17f-fa0c0a082aea req-05029673-9a65-4c5d-b22f-597f6a36536c service nova] Creating event network-changed:a1947c9b-406d-42f3-b1df-9498363d4e6e for instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 on hv-cinder-77387 Aug 19 09:30:38.284938 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-390c457b-c040-433b-b17f-fa0c0a082aea req-05029673-9a65-4c5d-b22f-597f6a36536c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036456 Aug 19 09:30:38.286160 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 693/1414] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:30:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:30:38.477740 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-78226886-4733-4a37-be45-aaa299b6aff7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:38.478353 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-78226886-4733-4a37-be45-aaa299b6aff7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:38.484105 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-78226886-4733-4a37-be45-aaa299b6aff7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:38.484558 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-78226886-4733-4a37-be45-aaa299b6aff7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:38.485320 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-78226886-4733-4a37-be45-aaa299b6aff7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:38.485752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-78226886-4733-4a37-be45-aaa299b6aff7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:38.603532 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-78226886-4733-4a37-be45-aaa299b6aff7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:38.610568 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-78226886-4733-4a37-be45-aaa299b6aff7 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.136755 Aug 19 09:30:38.611120 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 722/1415] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:38 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:39.628460 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7160f302-60c3-4210-89b0-9f4da86a0bd5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:39.629158 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7160f302-60c3-4210-89b0-9f4da86a0bd5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:39.635222 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7160f302-60c3-4210-89b0-9f4da86a0bd5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:39.635795 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7160f302-60c3-4210-89b0-9f4da86a0bd5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:39.636562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7160f302-60c3-4210-89b0-9f4da86a0bd5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:39.636994 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7160f302-60c3-4210-89b0-9f4da86a0bd5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:39.837977 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7160f302-60c3-4210-89b0-9f4da86a0bd5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:39.845035 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7160f302-60c3-4210-89b0-9f4da86a0bd5 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.220547 Aug 19 09:30:39.845586 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 694/1416] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:39 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:40.862589 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e148f670-6d63-43f6-a069-bc4df8a70027 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:40.863136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e148f670-6d63-43f6-a069-bc4df8a70027 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:40.869266 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e148f670-6d63-43f6-a069-bc4df8a70027 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:40.869721 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e148f670-6d63-43f6-a069-bc4df8a70027 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:40.870486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e148f670-6d63-43f6-a069-bc4df8a70027 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:40.870928 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e148f670-6d63-43f6-a069-bc4df8a70027 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:40.988647 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e148f670-6d63-43f6-a069-bc4df8a70027 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:40.996254 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e148f670-6d63-43f6-a069-bc4df8a70027 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.137364 Aug 19 09:30:40.996818 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 723/1417] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:40 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:42.013119 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d0ce80bd-4e23-49ab-a404-fe98a0a4d151 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:42.013662 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d0ce80bd-4e23-49ab-a404-fe98a0a4d151 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:42.019432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0ce80bd-4e23-49ab-a404-fe98a0a4d151 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:42.019882 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0ce80bd-4e23-49ab-a404-fe98a0a4d151 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:42.020646 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0ce80bd-4e23-49ab-a404-fe98a0a4d151 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:42.021084 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0ce80bd-4e23-49ab-a404-fe98a0a4d151 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:42.145645 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d0ce80bd-4e23-49ab-a404-fe98a0a4d151 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:42.152833 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d0ce80bd-4e23-49ab-a404-fe98a0a4d151 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.143471 Aug 19 09:30:42.153384 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 695/1418] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:42 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:43.170249 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8eca5030-c4dd-4853-9c50-e744f9651769 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:43.170863 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8eca5030-c4dd-4853-9c50-e744f9651769 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:43.176705 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8eca5030-c4dd-4853-9c50-e744f9651769 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:43.177157 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8eca5030-c4dd-4853-9c50-e744f9651769 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:43.177922 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8eca5030-c4dd-4853-9c50-e744f9651769 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:43.178358 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8eca5030-c4dd-4853-9c50-e744f9651769 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:43.300132 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8eca5030-c4dd-4853-9c50-e744f9651769 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:43.307653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8eca5030-c4dd-4853-9c50-e744f9651769 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.141022 Aug 19 09:30:43.308208 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 724/1419] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:43 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:43.430427 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:30:43.430916 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:30:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:30:43.753835 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-0670cc2d-9c16-4da3-a80f-373457067276 req-315b4ed3-f1fb-423f-a8fc-e6568032f503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ceaf8b9-1f54-4411-87e3-c5153b26aff5", "name": "network-vif-plugged", "status": "completed", "tag": "a1947c9b-406d-42f3-b1df-9498363d4e6e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:43.755312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:30:43.755312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:30:43.762747 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-0670cc2d-9c16-4da3-a80f-373457067276 req-315b4ed3-f1fb-423f-a8fc-e6568032f503 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:43.763189 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-0670cc2d-9c16-4da3-a80f-373457067276 req-315b4ed3-f1fb-423f-a8fc-e6568032f503 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:43.774340 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-0670cc2d-9c16-4da3-a80f-373457067276 req-315b4ed3-f1fb-423f-a8fc-e6568032f503 service nova] Creating event network-vif-plugged:a1947c9b-406d-42f3-b1df-9498363d4e6e for instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 on hv-cinder-77387 Aug 19 09:30:43.779115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-0670cc2d-9c16-4da3-a80f-373457067276 req-315b4ed3-f1fb-423f-a8fc-e6568032f503 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028996 Aug 19 09:30:43.779730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 696/1420] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:30:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:30:44.324303 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2d846e87-9626-4fa5-8747-974c4cbe4746 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:44.324823 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2d846e87-9626-4fa5-8747-974c4cbe4746 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:44.330464 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d846e87-9626-4fa5-8747-974c4cbe4746 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:44.330906 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d846e87-9626-4fa5-8747-974c4cbe4746 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:44.331727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d846e87-9626-4fa5-8747-974c4cbe4746 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:44.332117 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2d846e87-9626-4fa5-8747-974c4cbe4746 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:44.456021 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2d846e87-9626-4fa5-8747-974c4cbe4746 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:44.463294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2d846e87-9626-4fa5-8747-974c4cbe4746 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1358 microversion: 2.1 time: 0.142805 Aug 19 09:30:44.463844 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 725/1421] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:44 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:45.480802 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-e87b41f2-c4fb-482a-9d34-434f3d42cc97 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:45.481563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-e87b41f2-c4fb-482a-9d34-434f3d42cc97 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:45.488887 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e87b41f2-c4fb-482a-9d34-434f3d42cc97 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:45.489326 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e87b41f2-c4fb-482a-9d34-434f3d42cc97 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:45.490078 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e87b41f2-c4fb-482a-9d34-434f3d42cc97 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:45.490503 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-e87b41f2-c4fb-482a-9d34-434f3d42cc97 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:45.612908 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-e87b41f2-c4fb-482a-9d34-434f3d42cc97 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:45.620505 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-e87b41f2-c4fb-482a-9d34-434f3d42cc97 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1548 microversion: 2.1 time: 0.144021 Aug 19 09:30:45.621071 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 697/1422] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:45 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:45.636910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a865ffe6-c4b2-4cc3-9486-332459d26f25 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:45.637525 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a865ffe6-c4b2-4cc3-9486-332459d26f25 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:45.643384 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a865ffe6-c4b2-4cc3-9486-332459d26f25 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:45.643840 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a865ffe6-c4b2-4cc3-9486-332459d26f25 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:45.644603 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a865ffe6-c4b2-4cc3-9486-332459d26f25 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:45.645039 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a865ffe6-c4b2-4cc3-9486-332459d26f25 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:45.762866 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a865ffe6-c4b2-4cc3-9486-332459d26f25 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:45.770258 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a865ffe6-c4b2-4cc3-9486-332459d26f25 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1548 microversion: 2.1 time: 0.137751 Aug 19 09:30:45.770810 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 726/1423] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:45 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1548 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:30:45.786183 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c606325a-2a8d-40b7-8606-fa70b96d2939 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:45.789720 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:30:45.789720 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:30:45.790705 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c606325a-2a8d-40b7-8606-fa70b96d2939 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:45.791481 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c606325a-2a8d-40b7-8606-fa70b96d2939 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Searching by: {'deleted': False, 'project_id': '90530af20b71443db439806c0549e1c9'} {{(pid=107958) get_all /opt/stack/nova/nova/compute/api.py:2833}} Aug 19 09:30:45.797937 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c606325a-2a8d-40b7-8606-fa70b96d2939 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:45.798379 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c606325a-2a8d-40b7-8606-fa70b96d2939 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:45.799170 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c606325a-2a8d-40b7-8606-fa70b96d2939 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:45.799635 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c606325a-2a8d-40b7-8606-fa70b96d2939 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:45.888482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.multi_cell_list [None req-c606325a-2a8d-40b7-8606-fa70b96d2939 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=107958) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 19 09:30:45.983599 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c606325a-2a8d-40b7-8606-fa70b96d2939 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200826 Aug 19 09:30:45.984163 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 698/1424] 10.222.0.32 () {58 vars in 1125 bytes} [Thu Aug 19 09:30:45 2021] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:30:45.994518 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f168b83f-7c04-4baa-b073-5d2e437ed85b tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:45.995123 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f168b83f-7c04-4baa-b073-5d2e437ed85b tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:46.000827 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f168b83f-7c04-4baa-b073-5d2e437ed85b tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:46.001267 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f168b83f-7c04-4baa-b073-5d2e437ed85b tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:46.002019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f168b83f-7c04-4baa-b073-5d2e437ed85b tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:46.002441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f168b83f-7c04-4baa-b073-5d2e437ed85b tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:46.125428 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f168b83f-7c04-4baa-b073-5d2e437ed85b tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:46.132653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f168b83f-7c04-4baa-b073-5d2e437ed85b tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1548 microversion: 2.1 time: 0.142316 Aug 19 09:30:46.133832 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 727/1425] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:45 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1548 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:47.634585 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3db8309e-0ba1-4931-841f-62b12076a33a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80c4fd52-d21c-42d0-aa07-985965ace78b"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:47.635626 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3db8309e-0ba1-4931-841f-62b12076a33a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:47.641415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3db8309e-0ba1-4931-841f-62b12076a33a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:47.641862 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3db8309e-0ba1-4931-841f-62b12076a33a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:47.642618 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3db8309e-0ba1-4931-841f-62b12076a33a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:47.643049 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3db8309e-0ba1-4931-841f-62b12076a33a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:47.884765 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3db8309e-0ba1-4931-841f-62b12076a33a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "POST /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253506 Aug 19 09:30:47.885176 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 699/1426] 10.222.0.32 () {60 vars in 1323 bytes} [Thu Aug 19 09:30:47 2021] POST /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:30:55.440074 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-830fdd45-8f14-4385-9457-03beec3b2010 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:55.440682 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-830fdd45-8f14-4385-9457-03beec3b2010 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:55.447094 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-830fdd45-8f14-4385-9457-03beec3b2010 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:55.447622 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-830fdd45-8f14-4385-9457-03beec3b2010 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:55.448351 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-830fdd45-8f14-4385-9457-03beec3b2010 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:55.448777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-830fdd45-8f14-4385-9457-03beec3b2010 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:55.565445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-830fdd45-8f14-4385-9457-03beec3b2010 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:55.573016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-830fdd45-8f14-4385-9457-03beec3b2010 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1594 microversion: 2.1 time: 0.136942 Aug 19 09:30:55.573592 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 728/1427] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:55 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1594 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:57.435250 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-f6962b39-731e-4225-b7f9-0c764635316e req-85aef4ae-4d93-41c2-859a-4a89786f7a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ceaf8b9-1f54-4411-87e3-c5153b26aff5", "tag": "a1947c9b-406d-42f3-b1df-9498363d4e6e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:57.436715 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:30:57.436715 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:30:57.445563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-f6962b39-731e-4225-b7f9-0c764635316e req-85aef4ae-4d93-41c2-859a-4a89786f7a4d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:57.445998 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-f6962b39-731e-4225-b7f9-0c764635316e req-85aef4ae-4d93-41c2-859a-4a89786f7a4d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:57.457353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-f6962b39-731e-4225-b7f9-0c764635316e req-85aef4ae-4d93-41c2-859a-4a89786f7a4d service nova] Creating event network-changed:a1947c9b-406d-42f3-b1df-9498363d4e6e for instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 on hv-cinder-77387 Aug 19 09:30:57.464439 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-f6962b39-731e-4225-b7f9-0c764635316e req-85aef4ae-4d93-41c2-859a-4a89786f7a4d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033308 Aug 19 09:30:57.465233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 700/1428] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:30:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:30:58.426519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-64d16eb2-94a8-4de0-a39c-fb5c925450b2 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2135368627"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:58.427086 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-64d16eb2-94a8-4de0-a39c-fb5c925450b2 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:58.433802 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64d16eb2-94a8-4de0-a39c-fb5c925450b2 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:58.434248 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64d16eb2-94a8-4de0-a39c-fb5c925450b2 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:58.435021 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64d16eb2-94a8-4de0-a39c-fb5c925450b2 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:58.435491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-64d16eb2-94a8-4de0-a39c-fb5c925450b2 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:58.555089 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.network.security_group_api [None req-64d16eb2-94a8-4de0-a39c-fb5c925450b2 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Adding security group e7178cf9-f4ee-4d82-9a49-00cb9cff6957 to port a1947c9b-406d-42f3-b1df-9498363d4e6e Aug 19 09:30:58.930389 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-64d16eb2-94a8-4de0-a39c-fb5c925450b2 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "POST /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/action" status: 202 len: 0 microversion: 2.1 time: 0.507605 Aug 19 09:30:58.931498 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 729/1429] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:30:58 2021] POST /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:30:58.939827 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-f6c27e60-8403-4715-b57b-e8029c6d1cbf tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:30:58.940476 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-f6c27e60-8403-4715-b57b-e8029c6d1cbf tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:30:58.947149 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f6c27e60-8403-4715-b57b-e8029c6d1cbf tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:58.947626 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f6c27e60-8403-4715-b57b-e8029c6d1cbf tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:58.948395 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f6c27e60-8403-4715-b57b-e8029c6d1cbf tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:58.948830 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-f6c27e60-8403-4715-b57b-e8029c6d1cbf tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:59.082106 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-f6c27e60-8403-4715-b57b-e8029c6d1cbf tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:30:59.090560 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-f6c27e60-8403-4715-b57b-e8029c6d1cbf tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1759 microversion: 2.1 time: 0.154582 Aug 19 09:30:59.091947 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 701/1430] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:30:58 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1759 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:30:59.480890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-7b8adfac-83bc-4773-9991-616d1261371c req-e6847478-05e8-4812-b430-7ae54d891e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ceaf8b9-1f54-4411-87e3-c5153b26aff5", "tag": "a1947c9b-406d-42f3-b1df-9498363d4e6e"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:30:59.482368 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:30:59.482368 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:30:59.489124 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-7b8adfac-83bc-4773-9991-616d1261371c req-e6847478-05e8-4812-b430-7ae54d891e34 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:30:59.489566 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-7b8adfac-83bc-4773-9991-616d1261371c req-e6847478-05e8-4812-b430-7ae54d891e34 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:30:59.500517 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-7b8adfac-83bc-4773-9991-616d1261371c req-e6847478-05e8-4812-b430-7ae54d891e34 service nova] Creating event network-changed:a1947c9b-406d-42f3-b1df-9498363d4e6e for instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 on hv-cinder-77387 Aug 19 09:30:59.505741 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-7b8adfac-83bc-4773-9991-616d1261371c req-e6847478-05e8-4812-b430-7ae54d891e34 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028775 Aug 19 09:30:59.506318 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 730/1431] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:30:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:31:59.628575 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-398a1c98-51f6-4817-81bc-91fc6d78e8b9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:31:59.629493 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-398a1c98-51f6-4817-81bc-91fc6d78e8b9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:31:59.635396 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-398a1c98-51f6-4817-81bc-91fc6d78e8b9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:31:59.635854 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-398a1c98-51f6-4817-81bc-91fc6d78e8b9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:31:59.637118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-398a1c98-51f6-4817-81bc-91fc6d78e8b9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:31:59.637551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-398a1c98-51f6-4817-81bc-91fc6d78e8b9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:31:59.706064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-398a1c98-51f6-4817-81bc-91fc6d78e8b9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "POST /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/action" status: 202 len: 0 microversion: 2.1 time: 0.082129 Aug 19 09:31:59.709660 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 702/1432] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:31:59 2021] POST /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:31:59.717477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f2a3fdd6-edfa-4e07-a3ce-904ec91c9620 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:31:59.718273 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f2a3fdd6-edfa-4e07-a3ce-904ec91c9620 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:31:59.726138 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f2a3fdd6-edfa-4e07-a3ce-904ec91c9620 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:31:59.726606 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f2a3fdd6-edfa-4e07-a3ce-904ec91c9620 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:31:59.727652 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f2a3fdd6-edfa-4e07-a3ce-904ec91c9620 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:31:59.728341 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f2a3fdd6-edfa-4e07-a3ce-904ec91c9620 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:31:59.854477 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f2a3fdd6-edfa-4e07-a3ce-904ec91c9620 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:31:59.862975 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f2a3fdd6-edfa-4e07-a3ce-904ec91c9620 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1751 microversion: 2.1 time: 0.151305 Aug 19 09:31:59.863566 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 731/1433] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:31:59 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:00.881215 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-29f8480b-5228-4173-bf44-0ea72640deb9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:00.882002 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-29f8480b-5228-4173-bf44-0ea72640deb9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:00.888024 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-29f8480b-5228-4173-bf44-0ea72640deb9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:00.888468 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-29f8480b-5228-4173-bf44-0ea72640deb9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:00.889227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-29f8480b-5228-4173-bf44-0ea72640deb9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:00.889659 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-29f8480b-5228-4173-bf44-0ea72640deb9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:01.268653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-29f8480b-5228-4173-bf44-0ea72640deb9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:01.276388 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-29f8480b-5228-4173-bf44-0ea72640deb9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1756 microversion: 2.1 time: 0.399341 Aug 19 09:32:01.277498 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 703/1434] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:00 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1756 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:02.293921 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0b049d7b-9838-47e0-b8f6-942291bc4d15 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:02.294816 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0b049d7b-9838-47e0-b8f6-942291bc4d15 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:02.300653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b049d7b-9838-47e0-b8f6-942291bc4d15 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:02.301101 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b049d7b-9838-47e0-b8f6-942291bc4d15 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:02.301861 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b049d7b-9838-47e0-b8f6-942291bc4d15 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:02.302291 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0b049d7b-9838-47e0-b8f6-942291bc4d15 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:02.426361 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0b049d7b-9838-47e0-b8f6-942291bc4d15 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:02.433933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0b049d7b-9838-47e0-b8f6-942291bc4d15 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1756 microversion: 2.1 time: 0.143674 Aug 19 09:32:02.434493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 732/1435] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:02 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1756 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:03.451972 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-3c056e9a-fb2f-48b4-b14a-0d06d8bd6d7e tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:03.452583 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-3c056e9a-fb2f-48b4-b14a-0d06d8bd6d7e tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:03.458813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c056e9a-fb2f-48b4-b14a-0d06d8bd6d7e tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:03.459292 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c056e9a-fb2f-48b4-b14a-0d06d8bd6d7e tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:03.460028 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c056e9a-fb2f-48b4-b14a-0d06d8bd6d7e tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:03.460451 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-3c056e9a-fb2f-48b4-b14a-0d06d8bd6d7e tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:03.578719 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-3c056e9a-fb2f-48b4-b14a-0d06d8bd6d7e tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:03.586300 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-3c056e9a-fb2f-48b4-b14a-0d06d8bd6d7e tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1756 microversion: 2.1 time: 0.138716 Aug 19 09:32:03.586857 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 704/1436] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:03 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1756 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:04.603424 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8f6731fa-7aaf-4660-95bf-06ef96dd7273 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:04.603967 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8f6731fa-7aaf-4660-95bf-06ef96dd7273 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:04.610659 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f6731fa-7aaf-4660-95bf-06ef96dd7273 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:04.611109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f6731fa-7aaf-4660-95bf-06ef96dd7273 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:04.611910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f6731fa-7aaf-4660-95bf-06ef96dd7273 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:04.612343 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8f6731fa-7aaf-4660-95bf-06ef96dd7273 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:04.730180 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8f6731fa-7aaf-4660-95bf-06ef96dd7273 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:04.738808 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8f6731fa-7aaf-4660-95bf-06ef96dd7273 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1756 microversion: 2.1 time: 0.139287 Aug 19 09:32:04.739394 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 733/1437] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:04 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1756 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:05.756852 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7bf7992e-727f-4a5f-ad3d-8e02d6d88c79 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:05.757496 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7bf7992e-727f-4a5f-ad3d-8e02d6d88c79 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:05.763064 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7bf7992e-727f-4a5f-ad3d-8e02d6d88c79 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:05.764358 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7bf7992e-727f-4a5f-ad3d-8e02d6d88c79 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:05.765608 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7bf7992e-727f-4a5f-ad3d-8e02d6d88c79 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:05.766177 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-7bf7992e-727f-4a5f-ad3d-8e02d6d88c79 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:05.890544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7bf7992e-727f-4a5f-ad3d-8e02d6d88c79 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:05.898266 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7bf7992e-727f-4a5f-ad3d-8e02d6d88c79 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1756 microversion: 2.1 time: 0.145115 Aug 19 09:32:05.898820 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 705/1438] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:05 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1756 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:06.914992 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-560d776c-d6a6-418d-abd7-23121050cdcd tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:06.915625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-560d776c-d6a6-418d-abd7-23121050cdcd tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:06.921619 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-560d776c-d6a6-418d-abd7-23121050cdcd tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:06.922067 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-560d776c-d6a6-418d-abd7-23121050cdcd tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:06.922829 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-560d776c-d6a6-418d-abd7-23121050cdcd tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:06.923260 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-560d776c-d6a6-418d-abd7-23121050cdcd tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:07.043403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-560d776c-d6a6-418d-abd7-23121050cdcd tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:07.051033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-560d776c-d6a6-418d-abd7-23121050cdcd tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1756 microversion: 2.1 time: 0.139698 Aug 19 09:32:07.051636 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 734/1439] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:06 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1756 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:08.068278 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-070ef2e9-84f6-409a-8b30-cb257079e038 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:08.068807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-070ef2e9-84f6-409a-8b30-cb257079e038 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:08.074992 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-070ef2e9-84f6-409a-8b30-cb257079e038 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:08.075471 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-070ef2e9-84f6-409a-8b30-cb257079e038 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:08.076233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-070ef2e9-84f6-409a-8b30-cb257079e038 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:08.076667 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-070ef2e9-84f6-409a-8b30-cb257079e038 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:08.202732 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-070ef2e9-84f6-409a-8b30-cb257079e038 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:08.210296 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-070ef2e9-84f6-409a-8b30-cb257079e038 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1756 microversion: 2.1 time: 0.145747 Aug 19 09:32:08.210851 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 706/1440] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:08 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1756 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:09.227815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-58c59f45-6b8f-4d5e-9d84-d45eef77cdd9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:09.228671 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-58c59f45-6b8f-4d5e-9d84-d45eef77cdd9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:09.234910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58c59f45-6b8f-4d5e-9d84-d45eef77cdd9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:09.235394 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58c59f45-6b8f-4d5e-9d84-d45eef77cdd9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:09.236147 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58c59f45-6b8f-4d5e-9d84-d45eef77cdd9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:09.236574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-58c59f45-6b8f-4d5e-9d84-d45eef77cdd9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:09.361404 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-58c59f45-6b8f-4d5e-9d84-d45eef77cdd9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:09.369025 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-58c59f45-6b8f-4d5e-9d84-d45eef77cdd9 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1756 microversion: 2.1 time: 0.144913 Aug 19 09:32:09.369572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 735/1441] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:09 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1756 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:32:10.385702 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9a2052bc-e1bf-47b4-b484-26918dcdfbe1 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:10.386310 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9a2052bc-e1bf-47b4-b484-26918dcdfbe1 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:10.392599 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9a2052bc-e1bf-47b4-b484-26918dcdfbe1 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:10.393035 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9a2052bc-e1bf-47b4-b484-26918dcdfbe1 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:10.393786 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9a2052bc-e1bf-47b4-b484-26918dcdfbe1 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:10.394339 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9a2052bc-e1bf-47b4-b484-26918dcdfbe1 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:10.511356 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9a2052bc-e1bf-47b4-b484-26918dcdfbe1 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:10.519516 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9a2052bc-e1bf-47b4-b484-26918dcdfbe1 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1756 microversion: 2.1 time: 0.137400 Aug 19 09:32:10.520066 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 707/1442] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:10 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1756 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:11.535352 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-387e9e94-d3a2-4ef0-b269-f876ac632579 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:11.535944 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-387e9e94-d3a2-4ef0-b269-f876ac632579 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:11.541860 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-387e9e94-d3a2-4ef0-b269-f876ac632579 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:11.542297 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-387e9e94-d3a2-4ef0-b269-f876ac632579 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:11.543042 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-387e9e94-d3a2-4ef0-b269-f876ac632579 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:11.543503 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-387e9e94-d3a2-4ef0-b269-f876ac632579 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:11.664299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-387e9e94-d3a2-4ef0-b269-f876ac632579 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:11.672306 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-387e9e94-d3a2-4ef0-b269-f876ac632579 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1759 microversion: 2.1 time: 0.140615 Aug 19 09:32:11.673033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 736/1443] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:11 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1759 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:32.961473 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:32:32.963130 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:32:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:32:41.291401 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d5925c57-40e8-4033-9544-9db9e02c5a49 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:32:41.292103 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d5925c57-40e8-4033-9544-9db9e02c5a49 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:41.298256 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5925c57-40e8-4033-9544-9db9e02c5a49 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:41.298687 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5925c57-40e8-4033-9544-9db9e02c5a49 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:41.299465 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5925c57-40e8-4033-9544-9db9e02c5a49 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:41.299894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5925c57-40e8-4033-9544-9db9e02c5a49 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:41.322012 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.objects.instance [None req-d5925c57-40e8-4033-9544-9db9e02c5a49 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lazy-loading 'flavor' on Instance uuid 28718e64-45fc-43ba-8132-a59e7a0dbf86 {{(pid=107958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:32:41.391165 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d5925c57-40e8-4033-9544-9db9e02c5a49 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "POST /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86/action" status: 202 len: 0 microversion: 2.1 time: 0.103277 Aug 19 09:32:41.391773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 708/1444] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:32:41 2021] POST /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:32:41.399751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2690d6b6-9a03-4a3f-abc8-f0c7be152308 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:41.400469 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2690d6b6-9a03-4a3f-abc8-f0c7be152308 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:41.406813 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2690d6b6-9a03-4a3f-abc8-f0c7be152308 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:41.407359 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2690d6b6-9a03-4a3f-abc8-f0c7be152308 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:41.408095 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2690d6b6-9a03-4a3f-abc8-f0c7be152308 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:41.408565 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2690d6b6-9a03-4a3f-abc8-f0c7be152308 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:41.609201 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2690d6b6-9a03-4a3f-abc8-f0c7be152308 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:41.617249 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2690d6b6-9a03-4a3f-abc8-f0c7be152308 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.221187 Aug 19 09:32:41.617798 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 737/1445] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:41 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:42.634470 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d0a04518-0dcb-46ca-8086-59689b3bc94e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:42.635131 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d0a04518-0dcb-46ca-8086-59689b3bc94e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:42.641230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0a04518-0dcb-46ca-8086-59689b3bc94e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:42.641677 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0a04518-0dcb-46ca-8086-59689b3bc94e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:42.642441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0a04518-0dcb-46ca-8086-59689b3bc94e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:42.642897 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d0a04518-0dcb-46ca-8086-59689b3bc94e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:42.763700 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d0a04518-0dcb-46ca-8086-59689b3bc94e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:42.770985 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d0a04518-0dcb-46ca-8086-59689b3bc94e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.140616 Aug 19 09:32:42.771581 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 709/1446] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:42 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:43.787871 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-63989f66-e9d0-43a0-bb73-0e6b51ca5a43 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:43.788485 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-63989f66-e9d0-43a0-bb73-0e6b51ca5a43 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:43.794273 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-63989f66-e9d0-43a0-bb73-0e6b51ca5a43 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:43.794719 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-63989f66-e9d0-43a0-bb73-0e6b51ca5a43 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:43.795502 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-63989f66-e9d0-43a0-bb73-0e6b51ca5a43 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:43.795928 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-63989f66-e9d0-43a0-bb73-0e6b51ca5a43 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:43.917453 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-63989f66-e9d0-43a0-bb73-0e6b51ca5a43 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:43.924848 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-63989f66-e9d0-43a0-bb73-0e6b51ca5a43 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.140675 Aug 19 09:32:43.925408 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 738/1447] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:43 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:44.941546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c8c16cfb-d6dd-4198-b3d6-81c9a754d324 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:44.942157 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c8c16cfb-d6dd-4198-b3d6-81c9a754d324 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:44.947960 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c8c16cfb-d6dd-4198-b3d6-81c9a754d324 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:44.948406 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c8c16cfb-d6dd-4198-b3d6-81c9a754d324 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:44.949162 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c8c16cfb-d6dd-4198-b3d6-81c9a754d324 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:44.949589 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c8c16cfb-d6dd-4198-b3d6-81c9a754d324 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:45.068402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c8c16cfb-d6dd-4198-b3d6-81c9a754d324 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:45.075666 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c8c16cfb-d6dd-4198-b3d6-81c9a754d324 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.137813 Aug 19 09:32:45.076223 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 710/1448] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:44 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:46.093077 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7f6f23f8-8def-4c5a-9b74-035b61810f88 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:46.093605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7f6f23f8-8def-4c5a-9b74-035b61810f88 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:46.100092 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f6f23f8-8def-4c5a-9b74-035b61810f88 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:46.100540 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f6f23f8-8def-4c5a-9b74-035b61810f88 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:46.101302 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f6f23f8-8def-4c5a-9b74-035b61810f88 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:46.101729 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f6f23f8-8def-4c5a-9b74-035b61810f88 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:46.218016 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7f6f23f8-8def-4c5a-9b74-035b61810f88 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:46.225863 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7f6f23f8-8def-4c5a-9b74-035b61810f88 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.136498 Aug 19 09:32:46.226439 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 739/1449] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:46 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:47.242711 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5791efce-b2c4-4bdd-9aad-4b406bc0d733 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:47.243335 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5791efce-b2c4-4bdd-9aad-4b406bc0d733 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:47.249094 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5791efce-b2c4-4bdd-9aad-4b406bc0d733 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:47.249537 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5791efce-b2c4-4bdd-9aad-4b406bc0d733 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:47.251055 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5791efce-b2c4-4bdd-9aad-4b406bc0d733 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:47.251517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5791efce-b2c4-4bdd-9aad-4b406bc0d733 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:47.370807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5791efce-b2c4-4bdd-9aad-4b406bc0d733 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:47.379428 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5791efce-b2c4-4bdd-9aad-4b406bc0d733 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.139683 Aug 19 09:32:47.379674 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 711/1450] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:47 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:48.395996 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f41167a7-98ef-476b-81df-08bae5b8d01f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:48.396599 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f41167a7-98ef-476b-81df-08bae5b8d01f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:48.402313 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f41167a7-98ef-476b-81df-08bae5b8d01f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:48.402751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f41167a7-98ef-476b-81df-08bae5b8d01f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:48.403528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f41167a7-98ef-476b-81df-08bae5b8d01f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:48.403953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f41167a7-98ef-476b-81df-08bae5b8d01f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:48.521145 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f41167a7-98ef-476b-81df-08bae5b8d01f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:48.528295 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f41167a7-98ef-476b-81df-08bae5b8d01f tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.135890 Aug 19 09:32:48.528833 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 740/1451] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:48 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:49.544958 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1be0829b-9748-4184-b457-ef54cdedf65e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:49.545571 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1be0829b-9748-4184-b457-ef54cdedf65e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:49.551885 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1be0829b-9748-4184-b457-ef54cdedf65e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:49.552394 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1be0829b-9748-4184-b457-ef54cdedf65e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:49.553150 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1be0829b-9748-4184-b457-ef54cdedf65e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:49.553578 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1be0829b-9748-4184-b457-ef54cdedf65e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:49.674080 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1be0829b-9748-4184-b457-ef54cdedf65e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:49.681219 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1be0829b-9748-4184-b457-ef54cdedf65e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.139882 Aug 19 09:32:49.681774 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 712/1452] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:49 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:50.698390 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-75e8ee82-6bf1-4b36-9d38-bdc2e6f607c9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:50.698925 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-75e8ee82-6bf1-4b36-9d38-bdc2e6f607c9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:50.704896 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75e8ee82-6bf1-4b36-9d38-bdc2e6f607c9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:50.705362 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75e8ee82-6bf1-4b36-9d38-bdc2e6f607c9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:50.706161 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75e8ee82-6bf1-4b36-9d38-bdc2e6f607c9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:50.706594 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75e8ee82-6bf1-4b36-9d38-bdc2e6f607c9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:50.829788 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-75e8ee82-6bf1-4b36-9d38-bdc2e6f607c9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:50.836943 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-75e8ee82-6bf1-4b36-9d38-bdc2e6f607c9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.142309 Aug 19 09:32:50.837501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 741/1453] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:50 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:51.853710 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1e5b7aa5-bc1b-4cee-8303-f66a0e6bce33 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:51.855200 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1e5b7aa5-bc1b-4cee-8303-f66a0e6bce33 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:51.861648 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e5b7aa5-bc1b-4cee-8303-f66a0e6bce33 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:51.862096 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e5b7aa5-bc1b-4cee-8303-f66a0e6bce33 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:51.862859 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e5b7aa5-bc1b-4cee-8303-f66a0e6bce33 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:51.863320 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1e5b7aa5-bc1b-4cee-8303-f66a0e6bce33 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:52.044122 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-1e5b7aa5-bc1b-4cee-8303-f66a0e6bce33 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:52.051224 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1e5b7aa5-bc1b-4cee-8303-f66a0e6bce33 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.201158 Aug 19 09:32:52.051811 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 713/1454] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:51 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:53.065808 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: ERROR oslo.messaging._drivers.impl_rabbit [-] [417aa00e-8f3c-4b89-a0b4-6fd0c9e1ab49] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 19 09:32:53.069040 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fa62e893-2064-4615-9a20-aa9b4bb3a4cc tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:53.069677 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fa62e893-2064-4615-9a20-aa9b4bb3a4cc tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:53.075435 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa62e893-2064-4615-9a20-aa9b4bb3a4cc tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:53.075878 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa62e893-2064-4615-9a20-aa9b4bb3a4cc tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:53.076630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa62e893-2064-4615-9a20-aa9b4bb3a4cc tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:53.077055 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa62e893-2064-4615-9a20-aa9b4bb3a4cc tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:53.196984 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fa62e893-2064-4615-9a20-aa9b4bb3a4cc tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:53.204939 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fa62e893-2064-4615-9a20-aa9b4bb3a4cc tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.140605 Aug 19 09:32:53.205494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 742/1455] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:53 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:32:54.222322 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bf8a55d8-7c4b-4129-92d8-55ec9c53870d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:54.222933 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bf8a55d8-7c4b-4129-92d8-55ec9c53870d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:54.228856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bf8a55d8-7c4b-4129-92d8-55ec9c53870d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:54.229568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bf8a55d8-7c4b-4129-92d8-55ec9c53870d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:54.230364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bf8a55d8-7c4b-4129-92d8-55ec9c53870d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:54.230777 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bf8a55d8-7c4b-4129-92d8-55ec9c53870d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:54.353382 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bf8a55d8-7c4b-4129-92d8-55ec9c53870d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:54.361732 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bf8a55d8-7c4b-4129-92d8-55ec9c53870d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.143823 Aug 19 09:32:54.362499 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 714/1456] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:54 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:55.378440 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-74ccdeb0-244b-47b0-821c-f22661eaff38 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:55.379121 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-74ccdeb0-244b-47b0-821c-f22661eaff38 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:55.396590 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74ccdeb0-244b-47b0-821c-f22661eaff38 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:55.397040 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74ccdeb0-244b-47b0-821c-f22661eaff38 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:55.397811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74ccdeb0-244b-47b0-821c-f22661eaff38 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:55.398245 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-74ccdeb0-244b-47b0-821c-f22661eaff38 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:55.403263 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [-] [417aa00e-8f3c-4b89-a0b4-6fd0c9e1ab49] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 37666. Aug 19 09:32:55.516861 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-74ccdeb0-244b-47b0-821c-f22661eaff38 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:55.524213 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-74ccdeb0-244b-47b0-821c-f22661eaff38 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1510 microversion: 2.1 time: 0.150233 Aug 19 09:32:55.524774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 743/1457] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:55 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:55.540174 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-1a9e133a-1419-49d0-910e-dde33b8ea87e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:32:55.540748 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-1a9e133a-1419-49d0-910e-dde33b8ea87e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:55.546373 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1a9e133a-1419-49d0-910e-dde33b8ea87e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:55.546819 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1a9e133a-1419-49d0-910e-dde33b8ea87e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:55.548280 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1a9e133a-1419-49d0-910e-dde33b8ea87e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:55.548710 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-1a9e133a-1419-49d0-910e-dde33b8ea87e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:55.777219 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-1a9e133a-1419-49d0-910e-dde33b8ea87e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "POST /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86/action" status: 202 len: 0 microversion: 2.1 time: 0.240715 Aug 19 09:32:55.777803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 715/1458] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:32:55 2021] POST /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:32:55.786020 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-45a53a6e-af66-4053-b5af-dfedc24b23b4 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:55.786732 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-45a53a6e-af66-4053-b5af-dfedc24b23b4 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:55.792734 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45a53a6e-af66-4053-b5af-dfedc24b23b4 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:55.793177 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45a53a6e-af66-4053-b5af-dfedc24b23b4 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:55.793933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45a53a6e-af66-4053-b5af-dfedc24b23b4 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:55.794409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-45a53a6e-af66-4053-b5af-dfedc24b23b4 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:55.919163 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-45a53a6e-af66-4053-b5af-dfedc24b23b4 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:55.927097 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-45a53a6e-af66-4053-b5af-dfedc24b23b4 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1518 microversion: 2.1 time: 0.144699 Aug 19 09:32:55.927676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 744/1459] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:55 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1518 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:56.330898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-522a4379-feb8-49b5-9ab5-8a01c67001ca req-0a3af3a2-8868-4012-b52e-aadab5743195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28718e64-45fc-43ba-8132-a59e7a0dbf86", "name": "network-vif-unplugged", "status": "completed", "tag": "ef99c2b3-920f-4e54-9c11-002a92166219"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:32:56.333195 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:32:56.333195 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:32:56.340942 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-522a4379-feb8-49b5-9ab5-8a01c67001ca req-0a3af3a2-8868-4012-b52e-aadab5743195 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:56.341431 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-522a4379-feb8-49b5-9ab5-8a01c67001ca req-0a3af3a2-8868-4012-b52e-aadab5743195 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:56.352870 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.compute.server_external_events [req-522a4379-feb8-49b5-9ab5-8a01c67001ca req-0a3af3a2-8868-4012-b52e-aadab5743195 service nova] Unable to find a host for instance 28718e64-45fc-43ba-8132-a59e7a0dbf86. Dropping event network-vif-unplugged {{(pid=107958) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 19 09:32:56.353748 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-522a4379-feb8-49b5-9ab5-8a01c67001ca req-0a3af3a2-8868-4012-b52e-aadab5743195 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027343 Aug 19 09:32:56.355027 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 716/1460] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:32:56 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 19 09:32:56.944044 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fa9e9336-98d8-479f-9acd-956456438503 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:56.944676 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fa9e9336-98d8-479f-9acd-956456438503 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:56.950319 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa9e9336-98d8-479f-9acd-956456438503 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:56.950756 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa9e9336-98d8-479f-9acd-956456438503 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:56.951528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa9e9336-98d8-479f-9acd-956456438503 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:56.951956 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa9e9336-98d8-479f-9acd-956456438503 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:57.077188 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fa9e9336-98d8-479f-9acd-956456438503 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:57.085228 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fa9e9336-98d8-479f-9acd-956456438503 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1520 microversion: 2.1 time: 0.144939 Aug 19 09:32:57.085782 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 745/1461] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:56 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:58.103509 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0304c512-ea2f-4bf4-9557-a9e5d5377161 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:58.104114 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0304c512-ea2f-4bf4-9557-a9e5d5377161 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:58.111440 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0304c512-ea2f-4bf4-9557-a9e5d5377161 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:58.111913 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0304c512-ea2f-4bf4-9557-a9e5d5377161 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:58.112680 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0304c512-ea2f-4bf4-9557-a9e5d5377161 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:58.113116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0304c512-ea2f-4bf4-9557-a9e5d5377161 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:58.229298 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0304c512-ea2f-4bf4-9557-a9e5d5377161 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:58.237404 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0304c512-ea2f-4bf4-9557-a9e5d5377161 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.137491 Aug 19 09:32:58.237949 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 717/1462] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:58 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:32:59.254717 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-65208cd3-8a28-4e71-b2e7-2b5cfe0b4223 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:32:59.255405 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-65208cd3-8a28-4e71-b2e7-2b5cfe0b4223 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:32:59.261244 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-65208cd3-8a28-4e71-b2e7-2b5cfe0b4223 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:59.261686 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-65208cd3-8a28-4e71-b2e7-2b5cfe0b4223 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:59.262445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-65208cd3-8a28-4e71-b2e7-2b5cfe0b4223 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:32:59.262875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-65208cd3-8a28-4e71-b2e7-2b5cfe0b4223 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:32:59.380481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-65208cd3-8a28-4e71-b2e7-2b5cfe0b4223 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:32:59.387643 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-65208cd3-8a28-4e71-b2e7-2b5cfe0b4223 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.137268 Aug 19 09:32:59.388200 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 746/1463] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:32:59 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:00.404976 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5c228c7e-1fff-4946-8ca2-c791dedd2f6e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:00.405587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5c228c7e-1fff-4946-8ca2-c791dedd2f6e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:00.411330 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5c228c7e-1fff-4946-8ca2-c791dedd2f6e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:00.411769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5c228c7e-1fff-4946-8ca2-c791dedd2f6e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:00.412528 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5c228c7e-1fff-4946-8ca2-c791dedd2f6e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:00.412956 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5c228c7e-1fff-4946-8ca2-c791dedd2f6e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:00.533484 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-5c228c7e-1fff-4946-8ca2-c791dedd2f6e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:00.540551 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5c228c7e-1fff-4946-8ca2-c791dedd2f6e tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.139641 Aug 19 09:33:00.541097 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 718/1464] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:00 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:01.557187 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a0a07abc-3b3f-41f8-9ce6-ec4df2bfc116 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:01.557795 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a0a07abc-3b3f-41f8-9ce6-ec4df2bfc116 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:01.564230 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a0a07abc-3b3f-41f8-9ce6-ec4df2bfc116 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:01.564678 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a0a07abc-3b3f-41f8-9ce6-ec4df2bfc116 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:01.565437 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a0a07abc-3b3f-41f8-9ce6-ec4df2bfc116 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:01.565867 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a0a07abc-3b3f-41f8-9ce6-ec4df2bfc116 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:01.686577 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a0a07abc-3b3f-41f8-9ce6-ec4df2bfc116 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:01.693765 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a0a07abc-3b3f-41f8-9ce6-ec4df2bfc116 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.140189 Aug 19 09:33:01.694319 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 747/1465] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:01 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:02.710417 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c986e41d-a98e-4779-aee8-f22c85979e98 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:02.710959 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c986e41d-a98e-4779-aee8-f22c85979e98 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:02.716684 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c986e41d-a98e-4779-aee8-f22c85979e98 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:02.717122 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c986e41d-a98e-4779-aee8-f22c85979e98 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:02.717870 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c986e41d-a98e-4779-aee8-f22c85979e98 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:02.718294 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c986e41d-a98e-4779-aee8-f22c85979e98 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:02.836289 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c986e41d-a98e-4779-aee8-f22c85979e98 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:02.843416 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c986e41d-a98e-4779-aee8-f22c85979e98 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.136740 Aug 19 09:33:02.844172 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 719/1466] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:02 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:03.860034 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-80abb74f-8459-4fc5-b63a-a752a160cdd9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:03.860649 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-80abb74f-8459-4fc5-b63a-a752a160cdd9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:03.866403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-80abb74f-8459-4fc5-b63a-a752a160cdd9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:03.866851 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-80abb74f-8459-4fc5-b63a-a752a160cdd9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:03.867639 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-80abb74f-8459-4fc5-b63a-a752a160cdd9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:03.868075 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-80abb74f-8459-4fc5-b63a-a752a160cdd9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:03.983756 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-80abb74f-8459-4fc5-b63a-a752a160cdd9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:03.991127 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-80abb74f-8459-4fc5-b63a-a752a160cdd9 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.134989 Aug 19 09:33:03.991718 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 748/1467] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:03 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:05.008685 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8b8b0b6a-4c88-47a2-8e92-39edc50cc814 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:05.009292 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8b8b0b6a-4c88-47a2-8e92-39edc50cc814 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:05.015053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8b8b0b6a-4c88-47a2-8e92-39edc50cc814 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:05.015517 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8b8b0b6a-4c88-47a2-8e92-39edc50cc814 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:05.016484 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8b8b0b6a-4c88-47a2-8e92-39edc50cc814 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:05.016917 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-8b8b0b6a-4c88-47a2-8e92-39edc50cc814 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:05.135970 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8b8b0b6a-4c88-47a2-8e92-39edc50cc814 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:05.143677 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8b8b0b6a-4c88-47a2-8e92-39edc50cc814 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.138665 Aug 19 09:33:05.144227 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 720/1468] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:05 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:06.160508 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-35e9d1bf-be5e-4ea7-8c18-dda5045f86b6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:06.161127 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-35e9d1bf-be5e-4ea7-8c18-dda5045f86b6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:06.166959 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35e9d1bf-be5e-4ea7-8c18-dda5045f86b6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:06.167435 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35e9d1bf-be5e-4ea7-8c18-dda5045f86b6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:06.168195 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35e9d1bf-be5e-4ea7-8c18-dda5045f86b6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:06.168626 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-35e9d1bf-be5e-4ea7-8c18-dda5045f86b6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:06.286213 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-35e9d1bf-be5e-4ea7-8c18-dda5045f86b6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:06.293354 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-35e9d1bf-be5e-4ea7-8c18-dda5045f86b6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.137120 Aug 19 09:33:06.294114 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 749/1469] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:06 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:07.311624 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-40b0afed-3022-4894-a433-57ec35660004 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:07.312288 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-40b0afed-3022-4894-a433-57ec35660004 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:07.318674 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-40b0afed-3022-4894-a433-57ec35660004 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:07.319120 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-40b0afed-3022-4894-a433-57ec35660004 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:07.319922 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-40b0afed-3022-4894-a433-57ec35660004 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:07.320353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-40b0afed-3022-4894-a433-57ec35660004 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:07.442383 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-40b0afed-3022-4894-a433-57ec35660004 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:07.449506 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-40b0afed-3022-4894-a433-57ec35660004 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.141973 Aug 19 09:33:07.450051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 721/1470] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:07 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:33:08.444854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-80b45615-6b2a-49b1-a672-44a712f0b30d req-b73f7157-2e12-47a0-af10-3527afc141ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28718e64-45fc-43ba-8132-a59e7a0dbf86", "name": "network-vif-plugged", "status": "completed", "tag": "ef99c2b3-920f-4e54-9c11-002a92166219"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:33:08.446390 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:33:08.446390 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:33:08.454716 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-80b45615-6b2a-49b1-a672-44a712f0b30d req-b73f7157-2e12-47a0-af10-3527afc141ab service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:08.455158 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-80b45615-6b2a-49b1-a672-44a712f0b30d req-b73f7157-2e12-47a0-af10-3527afc141ab service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:08.466606 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bdb4be42-d7ba-4af7-8557-e6c6f73f95c5 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:08.467588 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bdb4be42-d7ba-4af7-8557-e6c6f73f95c5 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:08.469572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-80b45615-6b2a-49b1-a672-44a712f0b30d req-b73f7157-2e12-47a0-af10-3527afc141ab service nova] Creating event network-vif-plugged:ef99c2b3-920f-4e54-9c11-002a92166219 for instance 28718e64-45fc-43ba-8132-a59e7a0dbf86 on hv-cinder-77387 Aug 19 09:33:08.474278 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bdb4be42-d7ba-4af7-8557-e6c6f73f95c5 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:08.474801 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-80b45615-6b2a-49b1-a672-44a712f0b30d req-b73f7157-2e12-47a0-af10-3527afc141ab service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033465 Aug 19 09:33:08.475095 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bdb4be42-d7ba-4af7-8557-e6c6f73f95c5 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:08.475731 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 750/1471] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:33:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:33:08.476073 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bdb4be42-d7ba-4af7-8557-e6c6f73f95c5 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:08.476514 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bdb4be42-d7ba-4af7-8557-e6c6f73f95c5 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:08.598932 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bdb4be42-d7ba-4af7-8557-e6c6f73f95c5 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:08.607258 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bdb4be42-d7ba-4af7-8557-e6c6f73f95c5 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.144429 Aug 19 09:33:08.608342 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 722/1472] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:08 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:33:09.625008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-100dc6f2-4615-466e-9361-ec5d15da67ac tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:09.625729 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-100dc6f2-4615-466e-9361-ec5d15da67ac tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:09.631755 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-100dc6f2-4615-466e-9361-ec5d15da67ac tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:09.632139 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-100dc6f2-4615-466e-9361-ec5d15da67ac tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:09.632890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-100dc6f2-4615-466e-9361-ec5d15da67ac tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:09.633316 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-100dc6f2-4615-466e-9361-ec5d15da67ac tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:09.757605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-100dc6f2-4615-466e-9361-ec5d15da67ac tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:09.764758 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-100dc6f2-4615-466e-9361-ec5d15da67ac tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1576 microversion: 2.1 time: 0.143755 Aug 19 09:33:09.765307 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 751/1473] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:09 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1576 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:10.782531 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-114077be-eb2c-4cd3-ad95-8d266ca76ec6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:10.783053 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-114077be-eb2c-4cd3-ad95-8d266ca76ec6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:10.789295 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-114077be-eb2c-4cd3-ad95-8d266ca76ec6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:10.789740 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-114077be-eb2c-4cd3-ad95-8d266ca76ec6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:10.790498 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-114077be-eb2c-4cd3-ad95-8d266ca76ec6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:10.790929 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-114077be-eb2c-4cd3-ad95-8d266ca76ec6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:10.913015 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-114077be-eb2c-4cd3-ad95-8d266ca76ec6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:10.920210 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-114077be-eb2c-4cd3-ad95-8d266ca76ec6 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1563 microversion: 2.1 time: 0.141413 Aug 19 09:33:10.920762 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 723/1474] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:10 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:14.928524 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b802c013-f790-456d-9436-18d9228d969a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2135368627"}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:33:14.929087 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b802c013-f790-456d-9436-18d9228d969a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:14.934902 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b802c013-f790-456d-9436-18d9228d969a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:14.935399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b802c013-f790-456d-9436-18d9228d969a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:14.936166 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b802c013-f790-456d-9436-18d9228d969a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:14.936600 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b802c013-f790-456d-9436-18d9228d969a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:15.054133 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.network.security_group_api [None req-b802c013-f790-456d-9436-18d9228d969a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Removing security group e7178cf9-f4ee-4d82-9a49-00cb9cff6957 from port a1947c9b-406d-42f3-b1df-9498363d4e6e Aug 19 09:33:15.381299 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b802c013-f790-456d-9436-18d9228d969a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "POST /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/action" status: 202 len: 0 microversion: 2.1 time: 0.456366 Aug 19 09:33:15.385059 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 752/1475] 10.222.0.32 () {60 vars in 1278 bytes} [Thu Aug 19 09:33:14 2021] POST /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:33:15.489900 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-953ea8e9-387a-4065-973f-25bc3650649d req-ecfc7863-1e6b-489a-b2f5-43224503c7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ceaf8b9-1f54-4411-87e3-c5153b26aff5", "tag": "a1947c9b-406d-42f3-b1df-9498363d4e6e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:33:15.492040 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:33:15.492040 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:33:15.499513 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-953ea8e9-387a-4065-973f-25bc3650649d req-ecfc7863-1e6b-489a-b2f5-43224503c7ec service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:15.500380 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-953ea8e9-387a-4065-973f-25bc3650649d req-ecfc7863-1e6b-489a-b2f5-43224503c7ec service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:15.514375 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-953ea8e9-387a-4065-973f-25bc3650649d req-ecfc7863-1e6b-489a-b2f5-43224503c7ec service nova] Creating event network-changed:a1947c9b-406d-42f3-b1df-9498363d4e6e for instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 on hv-cinder-77387 Aug 19 09:33:15.519803 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-953ea8e9-387a-4065-973f-25bc3650649d req-ecfc7863-1e6b-489a-b2f5-43224503c7ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133864 Aug 19 09:33:15.523431 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 724/1476] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:33:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:33:16.463123 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-106395f7-6c62-49ab-b46f-0bade8580e02 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:16.463728 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-106395f7-6c62-49ab-b46f-0bade8580e02 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:16.470281 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-106395f7-6c62-49ab-b46f-0bade8580e02 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:16.470806 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-106395f7-6c62-49ab-b46f-0bade8580e02 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:16.471675 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-106395f7-6c62-49ab-b46f-0bade8580e02 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:16.472183 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-106395f7-6c62-49ab-b46f-0bade8580e02 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:16.555453 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-106395f7-6c62-49ab-b46f-0bade8580e02 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lazy-loading 'services' on Instance uuid 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:33:16.623910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-106395f7-6c62-49ab-b46f-0bade8580e02 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/os-volume_attachments/80c4fd52-d21c-42d0-aa07-985965ace78b" status: 202 len: 0 microversion: 2.1 time: 0.164233 Aug 19 09:33:16.624616 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 753/1477] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:33:16 2021] DELETE /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/os-volume_attachments/80c4fd52-d21c-42d0-aa07-985965ace78b => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:33:16.634088 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9232bb3d-c394-4fee-907b-87e886ace018 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:16.635101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9232bb3d-c394-4fee-907b-87e886ace018 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:16.641556 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9232bb3d-c394-4fee-907b-87e886ace018 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:16.642003 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9232bb3d-c394-4fee-907b-87e886ace018 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:16.642793 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9232bb3d-c394-4fee-907b-87e886ace018 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:16.643222 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9232bb3d-c394-4fee-907b-87e886ace018 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:16.674288 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9232bb3d-c394-4fee-907b-87e886ace018 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Aug 19 09:33:16.675054 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 725/1478] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:33:16 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:33:17.536973 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-c61751ba-d82c-4ab6-b798-3d96ace23295 req-3b430198-43ad-419f-9a5e-06df3ec1ffb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ceaf8b9-1f54-4411-87e3-c5153b26aff5", "tag": "a1947c9b-406d-42f3-b1df-9498363d4e6e"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:33:17.538520 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:33:17.538520 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:33:17.545540 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-c61751ba-d82c-4ab6-b798-3d96ace23295 req-3b430198-43ad-419f-9a5e-06df3ec1ffb7 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:17.545978 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-c61751ba-d82c-4ab6-b798-3d96ace23295 req-3b430198-43ad-419f-9a5e-06df3ec1ffb7 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:17.556650 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-c61751ba-d82c-4ab6-b798-3d96ace23295 req-3b430198-43ad-419f-9a5e-06df3ec1ffb7 service nova] Creating event network-changed:a1947c9b-406d-42f3-b1df-9498363d4e6e for instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 on hv-cinder-77387 Aug 19 09:33:17.561252 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-c61751ba-d82c-4ab6-b798-3d96ace23295 req-3b430198-43ad-419f-9a5e-06df3ec1ffb7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030308 Aug 19 09:33:17.561988 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 754/1479] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:33:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:33:17.685800 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6de3ab5e-83b6-489b-80ce-de4c7b160c05 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:17.686719 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6de3ab5e-83b6-489b-80ce-de4c7b160c05 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:17.693121 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6de3ab5e-83b6-489b-80ce-de4c7b160c05 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:17.693559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6de3ab5e-83b6-489b-80ce-de4c7b160c05 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:17.694322 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6de3ab5e-83b6-489b-80ce-de4c7b160c05 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:17.694749 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6de3ab5e-83b6-489b-80ce-de4c7b160c05 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:17.723422 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6de3ab5e-83b6-489b-80ce-de4c7b160c05 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041280 Aug 19 09:33:17.723977 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 726/1480] 10.222.0.32 () {58 vars in 1302 bytes} [Thu Aug 19 09:33:17 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 19 09:33:17.734052 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3368aeb8-814b-40e8-8298-a24d0cdc360a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:17.734715 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3368aeb8-814b-40e8-8298-a24d0cdc360a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:17.740585 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3368aeb8-814b-40e8-8298-a24d0cdc360a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:17.741026 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3368aeb8-814b-40e8-8298-a24d0cdc360a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:17.741778 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3368aeb8-814b-40e8-8298-a24d0cdc360a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:17.742208 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3368aeb8-814b-40e8-8298-a24d0cdc360a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:17.820788 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-3368aeb8-814b-40e8-8298-a24d0cdc360a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] HTTP exception thrown: Instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 is not attached to volume 80c4fd52-d21c-42d0-aa07-985965ace78b Aug 19 09:33:17.821410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3368aeb8-814b-40e8-8298-a24d0cdc360a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Returning 404 to user: Instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 is not attached to volume 80c4fd52-d21c-42d0-aa07-985965ace78b {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:33:17.822237 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3368aeb8-814b-40e8-8298-a24d0cdc360a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/os-volume_attachments/80c4fd52-d21c-42d0-aa07-985965ace78b" status: 404 len: 154 microversion: 2.1 time: 0.092522 Aug 19 09:33:17.822785 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 755/1481] 10.222.0.32 () {58 vars in 1416 bytes} [Thu Aug 19 09:33:17 2021] DELETE /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5/os-volume_attachments/80c4fd52-d21c-42d0-aa07-985965ace78b => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 19 09:33:18.955374 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-5271046b-2116-463a-bb7f-1dcbb39c53be tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:18.955856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5271046b-2116-463a-bb7f-1dcbb39c53be tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:18.961456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5271046b-2116-463a-bb7f-1dcbb39c53be tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:18.961894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5271046b-2116-463a-bb7f-1dcbb39c53be tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:18.962644 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5271046b-2116-463a-bb7f-1dcbb39c53be tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:18.963069 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-5271046b-2116-463a-bb7f-1dcbb39c53be tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:18.987343 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-5271046b-2116-463a-bb7f-1dcbb39c53be tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:33:19.056838 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-5271046b-2116-463a-bb7f-1dcbb39c53be tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 204 len: 0 microversion: 2.1 time: 0.104934 Aug 19 09:33:19.057482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 727/1482] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:33:18 2021] DELETE /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:33:19.065445 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d2d3c10f-eba2-409b-95d5-5ecb860a776d tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:19.066058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d2d3c10f-eba2-409b-95d5-5ecb860a776d tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:19.071760 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d2d3c10f-eba2-409b-95d5-5ecb860a776d tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:19.072208 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d2d3c10f-eba2-409b-95d5-5ecb860a776d tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:19.072963 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d2d3c10f-eba2-409b-95d5-5ecb860a776d tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:19.073398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d2d3c10f-eba2-409b-95d5-5ecb860a776d tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:19.195369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d2d3c10f-eba2-409b-95d5-5ecb860a776d tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:19.202505 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d2d3c10f-eba2-409b-95d5-5ecb860a776d tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1554 microversion: 2.1 time: 0.140816 Aug 19 09:33:19.203102 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 756/1483] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:19 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1554 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:20.221047 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-57493c14-2ac2-4eb1-b5a3-14eea71a7dcb tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:20.221746 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-57493c14-2ac2-4eb1-b5a3-14eea71a7dcb tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:20.227534 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-57493c14-2ac2-4eb1-b5a3-14eea71a7dcb tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:20.227972 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-57493c14-2ac2-4eb1-b5a3-14eea71a7dcb tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:20.228735 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-57493c14-2ac2-4eb1-b5a3-14eea71a7dcb tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:20.229220 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-57493c14-2ac2-4eb1-b5a3-14eea71a7dcb tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:20.397598 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-57493c14-2ac2-4eb1-b5a3-14eea71a7dcb tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:20.404808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-57493c14-2ac2-4eb1-b5a3-14eea71a7dcb tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1554 microversion: 2.1 time: 0.188463 Aug 19 09:33:20.405371 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 728/1484] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:20 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:21.421893 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6f60a6ab-c8ea-435f-970f-e813213fd91a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:21.422607 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6f60a6ab-c8ea-435f-970f-e813213fd91a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:21.428369 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f60a6ab-c8ea-435f-970f-e813213fd91a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:21.428815 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f60a6ab-c8ea-435f-970f-e813213fd91a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:21.429576 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f60a6ab-c8ea-435f-970f-e813213fd91a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:21.430008 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6f60a6ab-c8ea-435f-970f-e813213fd91a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:21.497940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6f60a6ab-c8ea-435f-970f-e813213fd91a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb9d7220b6d4025b59129ec0323faf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90530af20b71443db439806c0549e1c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:33:21.517515 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6f60a6ab-c8ea-435f-970f-e813213fd91a tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 200 len: 1512 microversion: 2.1 time: 0.099316 Aug 19 09:33:21.518297 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 757/1485] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:21 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 1512 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:33:21.544809 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-550952b8-c22c-4780-b92f-66f18114b11b req-91afa705-5ca6-4037-83a4-d22f07c3551b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ceaf8b9-1f54-4411-87e3-c5153b26aff5", "name": "network-vif-deleted", "tag": "a1947c9b-406d-42f3-b1df-9498363d4e6e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:33:21.546677 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:33:21.546677 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:33:21.554469 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-550952b8-c22c-4780-b92f-66f18114b11b req-91afa705-5ca6-4037-83a4-d22f07c3551b service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:21.555005 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-550952b8-c22c-4780-b92f-66f18114b11b req-91afa705-5ca6-4037-83a4-d22f07c3551b service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:21.567392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-550952b8-c22c-4780-b92f-66f18114b11b req-91afa705-5ca6-4037-83a4-d22f07c3551b service nova] Creating event network-vif-deleted:a1947c9b-406d-42f3-b1df-9498363d4e6e for instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 on hv-cinder-77387 Aug 19 09:33:21.572061 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-550952b8-c22c-4780-b92f-66f18114b11b req-91afa705-5ca6-4037-83a4-d22f07c3551b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030829 Aug 19 09:33:21.572637 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 729/1486] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:33:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:33:22.535556 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cc864855-0161-420e-8083-63cda6b2225c tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:22.536170 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-cc864855-0161-420e-8083-63cda6b2225c tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] [instance: 3ceaf8b9-1f54-4411-87e3-c5153b26aff5] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:33:22.541954 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cc864855-0161-420e-8083-63cda6b2225c tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:22.542407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cc864855-0161-420e-8083-63cda6b2225c tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:22.543168 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cc864855-0161-420e-8083-63cda6b2225c tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:33:22.543627 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-cc864855-0161-420e-8083-63cda6b2225c tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:33:22.710533 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-cc864855-0161-420e-8083-63cda6b2225c tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] HTTP exception thrown: Instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 could not be found. Aug 19 09:33:22.711041 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-cc864855-0161-420e-8083-63cda6b2225c tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Returning 404 to user: Instance 3ceaf8b9-1f54-4411-87e3-c5153b26aff5 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:33:22.711903 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-cc864855-0161-420e-8083-63cda6b2225c tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5" status: 404 len: 111 microversion: 2.1 time: 0.180805 Aug 19 09:33:22.712442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 758/1487] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:33:22 2021] GET /compute/v2.1/servers/3ceaf8b9-1f54-4411-87e3-c5153b26aff5 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:33:22.721544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8e6e0344-d010-4602-a161-a78cd6111454 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] Calling method '.version_select at 0x7fdb85299e50>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:33:22.741472 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8e6e0344-d010-4602-a161-a78cd6111454 tempest-TestMinimumBasicScenario-1894658311 tempest-TestMinimumBasicScenario-1894658311-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1168471457" status: 202 len: 0 microversion: 2.1 time: 0.024520 Aug 19 09:33:22.742007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 730/1488] 10.222.0.32 () {58 vars in 1272 bytes} [Thu Aug 19 09:33:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1168471457 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:34:38.663610 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-fe70765e-d76d-43f0-a95c-adeb012e3c56 req-05dcb8de-cb38-4b5f-8784-78c9b176bf6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28718e64-45fc-43ba-8132-a59e7a0dbf86", "tag": "ef99c2b3-920f-4e54-9c11-002a92166219"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:34:38.665281 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:34:38.665281 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:34:38.673216 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-fe70765e-d76d-43f0-a95c-adeb012e3c56 req-05dcb8de-cb38-4b5f-8784-78c9b176bf6c service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:38.673768 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-fe70765e-d76d-43f0-a95c-adeb012e3c56 req-05dcb8de-cb38-4b5f-8784-78c9b176bf6c service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:38.684067 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-fe70765e-d76d-43f0-a95c-adeb012e3c56 req-05dcb8de-cb38-4b5f-8784-78c9b176bf6c service nova] Creating event network-changed:ef99c2b3-920f-4e54-9c11-002a92166219 for instance 28718e64-45fc-43ba-8132-a59e7a0dbf86 on hv-cinder-77387 Aug 19 09:34:38.690110 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-fe70765e-d76d-43f0-a95c-adeb012e3c56 req-05dcb8de-cb38-4b5f-8784-78c9b176bf6c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031705 Aug 19 09:34:38.690906 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 731/1489] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:34:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:34:38.831247 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-450c1be8-10b7-4738-aa91-5dc9e95e1cfa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:34:38.831799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-450c1be8-10b7-4738-aa91-5dc9e95e1cfa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:34:38.837460 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-450c1be8-10b7-4738-aa91-5dc9e95e1cfa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:38.837912 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-450c1be8-10b7-4738-aa91-5dc9e95e1cfa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:38.838672 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-450c1be8-10b7-4738-aa91-5dc9e95e1cfa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:38.839101 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-450c1be8-10b7-4738-aa91-5dc9e95e1cfa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:38.864751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-450c1be8-10b7-4738-aa91-5dc9e95e1cfa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Going to try to terminate instance {{(pid=107957) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:34:38.949497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-450c1be8-10b7-4738-aa91-5dc9e95e1cfa tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "DELETE /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 204 len: 0 microversion: 2.1 time: 0.293638 Aug 19 09:34:38.950936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 759/1490] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:34:38 2021] DELETE /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 19 09:34:38.959592 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6f6e71f7-7305-4031-9bed-6e5e3c5e7dfe tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:34:38.960312 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6f6e71f7-7305-4031-9bed-6e5e3c5e7dfe tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:34:38.970045 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f6e71f7-7305-4031-9bed-6e5e3c5e7dfe tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:38.970500 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f6e71f7-7305-4031-9bed-6e5e3c5e7dfe tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:38.971316 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f6e71f7-7305-4031-9bed-6e5e3c5e7dfe tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:38.971758 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f6e71f7-7305-4031-9bed-6e5e3c5e7dfe tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:39.167782 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6f6e71f7-7305-4031-9bed-6e5e3c5e7dfe tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:34:39.175238 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6f6e71f7-7305-4031-9bed-6e5e3c5e7dfe tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1569 microversion: 2.1 time: 0.219646 Aug 19 09:34:39.175902 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 732/1491] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:34:38 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:34:40.193151 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-93848b9a-f90a-436a-8a09-1e81f4a53b4a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:34:40.193837 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-93848b9a-f90a-436a-8a09-1e81f4a53b4a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:34:40.199549 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93848b9a-f90a-436a-8a09-1e81f4a53b4a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:40.199991 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93848b9a-f90a-436a-8a09-1e81f4a53b4a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:40.200741 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93848b9a-f90a-436a-8a09-1e81f4a53b4a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:40.201175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-93848b9a-f90a-436a-8a09-1e81f4a53b4a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:40.321769 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-93848b9a-f90a-436a-8a09-1e81f4a53b4a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:34:40.330964 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-93848b9a-f90a-436a-8a09-1e81f4a53b4a tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1450 microversion: 2.1 time: 0.141878 Aug 19 09:34:40.331545 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 760/1492] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:34:40 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1450 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:34:41.302297 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-df3bf1b6-cb63-41e6-afaf-c635c14d6ea0 req-18d6bcb9-0525-4bf4-9235-60ca628f7ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28718e64-45fc-43ba-8132-a59e7a0dbf86", "name": "network-vif-deleted", "tag": "ef99c2b3-920f-4e54-9c11-002a92166219"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:34:41.303953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:34:41.303953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:34:41.310898 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-df3bf1b6-cb63-41e6-afaf-c635c14d6ea0 req-18d6bcb9-0525-4bf4-9235-60ca628f7ef0 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:41.311363 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-df3bf1b6-cb63-41e6-afaf-c635c14d6ea0 req-18d6bcb9-0525-4bf4-9235-60ca628f7ef0 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:41.322276 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-df3bf1b6-cb63-41e6-afaf-c635c14d6ea0 req-18d6bcb9-0525-4bf4-9235-60ca628f7ef0 service nova] Creating event network-vif-deleted:ef99c2b3-920f-4e54-9c11-002a92166219 for instance 28718e64-45fc-43ba-8132-a59e7a0dbf86 on hv-cinder-77387 Aug 19 09:34:41.326793 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-df3bf1b6-cb63-41e6-afaf-c635c14d6ea0 req-18d6bcb9-0525-4bf4-9235-60ca628f7ef0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091133 Aug 19 09:34:41.327399 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 733/1493] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:34:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:34:41.348175 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a5fb456d-e960-41df-98af-9dd9223beadd tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:34:41.348889 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a5fb456d-e960-41df-98af-9dd9223beadd tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:34:41.354931 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5fb456d-e960-41df-98af-9dd9223beadd tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:41.355411 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5fb456d-e960-41df-98af-9dd9223beadd tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:41.356180 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5fb456d-e960-41df-98af-9dd9223beadd tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:41.356615 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a5fb456d-e960-41df-98af-9dd9223beadd tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:41.415601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a5fb456d-e960-41df-98af-9dd9223beadd tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa90df3873954392a91682d8470e25e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1ca56a68b40f693d7f41d1f8646d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:34:41.423265 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a5fb456d-e960-41df-98af-9dd9223beadd tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 200 len: 1220 microversion: 2.1 time: 0.078699 Aug 19 09:34:41.423830 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 761/1494] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:34:41 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:34:42.441340 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-90e796df-0cac-47ef-a8f7-9c2756a81e05 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:34:42.442038 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-90e796df-0cac-47ef-a8f7-9c2756a81e05 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [instance: 28718e64-45fc-43ba-8132-a59e7a0dbf86] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:34:42.448346 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-90e796df-0cac-47ef-a8f7-9c2756a81e05 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:42.448794 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-90e796df-0cac-47ef-a8f7-9c2756a81e05 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:42.449563 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-90e796df-0cac-47ef-a8f7-9c2756a81e05 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:34:42.449999 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-90e796df-0cac-47ef-a8f7-9c2756a81e05 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:34:42.463372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-90e796df-0cac-47ef-a8f7-9c2756a81e05 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] HTTP exception thrown: Instance 28718e64-45fc-43ba-8132-a59e7a0dbf86 could not be found. Aug 19 09:34:42.463962 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-90e796df-0cac-47ef-a8f7-9c2756a81e05 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Returning 404 to user: Instance 28718e64-45fc-43ba-8132-a59e7a0dbf86 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:34:42.464780 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-90e796df-0cac-47ef-a8f7-9c2756a81e05 tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86" status: 404 len: 111 microversion: 2.1 time: 0.028570 Aug 19 09:34:42.465307 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 734/1495] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:34:42 2021] GET /compute/v2.1/servers/28718e64-45fc-43ba-8132-a59e7a0dbf86 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:34:42.619919 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-867b58e4-626c-4f91-8cbf-e8faaabb823d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] Calling method '.version_select at 0x7fdb803a9b80>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:34:42.624555 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: ERROR oslo.messaging._drivers.impl_rabbit [None req-867b58e4-626c-4f91-8cbf-e8faaabb823d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [87159d87-c8e4-4a92-9f1f-37538af5eadd] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 09:34:43.642514 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [None req-867b58e4-626c-4f91-8cbf-e8faaabb823d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] [87159d87-c8e4-4a92-9f1f-37538af5eadd] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 37894. Aug 19 09:34:43.660837 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-867b58e4-626c-4f91-8cbf-e8faaabb823d tempest-TestShelveInstance-222751568 tempest-TestShelveInstance-222751568-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1751414454" status: 202 len: 0 microversion: 2.1 time: 1.044545 Aug 19 09:34:43.661438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 762/1496] 10.222.0.32 () {58 vars in 1254 bytes} [Thu Aug 19 09:34:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1751414454 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:35:00.810283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-eb487040-7ec3-4930-8b4b-c8b68e8bf627 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Action: 'create', calling method: .version_select at 0x7fdb8510a700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1199316966"}} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:35:00.836203 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-eb487040-7ec3-4930-8b4b-c8b68e8bf627 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Getting quotas for project 6ef73bc3b1c2403f95cfd6ee506880a9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:35:00.840408 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-eb487040-7ec3-4930-8b4b-c8b68e8bf627 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Getting quotas for user 4f8e509570f24d1e9bd12281b17329f8 and project 6ef73bc3b1c2403f95cfd6ee506880a9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:35:01.008511 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-eb487040-7ec3-4930-8b4b-c8b68e8bf627 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Getting quotas for project 6ef73bc3b1c2403f95cfd6ee506880a9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:35:01.012150 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.quota [None req-eb487040-7ec3-4930-8b4b-c8b68e8bf627 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Getting quotas for user 4f8e509570f24d1e9bd12281b17329f8 and project 6ef73bc3b1c2403f95cfd6ee506880a9. Resources: {'key_pairs'} {{(pid=107958) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:35:01.025939 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-eb487040-7ec3-4930-8b4b-c8b68e8bf627 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.456722 Aug 19 09:35:01.026533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 735/1497] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Aug 19 09:35:00 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:35:24.607399 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-160723166", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1199316966", "security_groups": [{"name": "tempest-secgroup-smoke-1911394237"}], "block_device_mapping_v2": [{"uuid": "72d66fbf-5ad9-4fd6-87dc-c2ce44ce195c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "45b3c501-5e27-451f-bd0f-84a09e2e10a6"}]}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:35:24.709741 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.network.neutron [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] validate_networks() for [('45b3c501-5e27-451f-bd0f-84a09e2e10a6', None, None, None, None, None)] {{(pid=107957) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:35:25.148621 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Flavor limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:35:25.149052 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Image limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:35:25.149523 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Flavor pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:35:25.149960 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Image pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:35:25.150371 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:35:25.158666 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:25.159119 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:25.159953 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:25.160388 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:25.176467 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Getting quotas for project 6ef73bc3b1c2403f95cfd6ee506880a9. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:35:25.180441 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Getting quotas for user 4f8e509570f24d1e9bd12281b17329f8 and project 6ef73bc3b1c2403f95cfd6ee506880a9. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:35:25.238336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Going to run 1 instances... {{(pid=107957) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:35:25.240486 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72d66fbf-5ad9-4fd6-87dc-c2ce44ce195c',volume_size=None,volume_type=None)] {{(pid=107957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:35:25.356493 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [62fc327a-67b0-4ec4-8e54-60a2c8dc97ec] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 19 09:35:26.373640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [62fc327a-67b0-4ec4-8e54-60a2c8dc97ec] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 38130. Aug 19 09:35:26.380148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-3714daf8-04b8-4dff-a2fb-360d04b572e4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.776622 Aug 19 09:35:26.380782 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 763/1498] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:35:24 2021] POST /compute/v2.1/servers => generated 406 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:35:26.390522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-acf7423a-d05c-402a-a6b0-a279341d3328 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:26.391132 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-acf7423a-d05c-402a-a6b0-a279341d3328 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:26.444757 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-acf7423a-d05c-402a-a6b0-a279341d3328 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:26.451744 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-acf7423a-d05c-402a-a6b0-a279341d3328 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1094 microversion: 2.1 time: 0.065068 Aug 19 09:35:26.452283 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 736/1499] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:26 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:27.469104 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0166d0b8-019d-4d4a-8a6e-62b1f8be26f9 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:27.469714 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0166d0b8-019d-4d4a-8a6e-62b1f8be26f9 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:27.521215 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0166d0b8-019d-4d4a-8a6e-62b1f8be26f9 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:27.527531 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0166d0b8-019d-4d4a-8a6e-62b1f8be26f9 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1094 microversion: 2.1 time: 0.062055 Aug 19 09:35:27.528167 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 764/1500] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:27 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:28.544147 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6d62acca-e584-45a1-82fc-b9ad16abdfcb tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:28.544751 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6d62acca-e584-45a1-82fc-b9ad16abdfcb tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:28.594522 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6d62acca-e584-45a1-82fc-b9ad16abdfcb tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:28.600930 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6d62acca-e584-45a1-82fc-b9ad16abdfcb tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1094 microversion: 2.1 time: 0.060432 Aug 19 09:35:28.601475 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 737/1501] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:28 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1094 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:29.618454 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c0d8750b-c4c2-4a9d-909b-66b07b62fad3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:29.619065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c0d8750b-c4c2-4a9d-909b-66b07b62fad3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:29.669934 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c0d8750b-c4c2-4a9d-909b-66b07b62fad3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:29.676742 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c0d8750b-c4c2-4a9d-909b-66b07b62fad3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1094 microversion: 2.1 time: 0.062541 Aug 19 09:35:29.677277 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 765/1502] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:29 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:30.693549 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c023bbee-67e0-41c3-92e6-f15b19e678e3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:30.694115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c023bbee-67e0-41c3-92e6-f15b19e678e3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:30.700675 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c023bbee-67e0-41c3-92e6-f15b19e678e3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:30.701118 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c023bbee-67e0-41c3-92e6-f15b19e678e3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:30.701911 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c023bbee-67e0-41c3-92e6-f15b19e678e3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:30.702338 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c023bbee-67e0-41c3-92e6-f15b19e678e3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:30.760559 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c023bbee-67e0-41c3-92e6-f15b19e678e3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:30.767562 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c023bbee-67e0-41c3-92e6-f15b19e678e3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1144 microversion: 2.1 time: 0.077716 Aug 19 09:35:30.768119 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 738/1503] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:30 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:35:31.783876 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6564cbc1-b4eb-4e74-bd6e-0988b549c668 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:31.784502 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6564cbc1-b4eb-4e74-bd6e-0988b549c668 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:31.790504 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6564cbc1-b4eb-4e74-bd6e-0988b549c668 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:31.790956 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6564cbc1-b4eb-4e74-bd6e-0988b549c668 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:31.791766 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6564cbc1-b4eb-4e74-bd6e-0988b549c668 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:31.792205 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6564cbc1-b4eb-4e74-bd6e-0988b549c668 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:31.854546 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6564cbc1-b4eb-4e74-bd6e-0988b549c668 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:31.862500 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6564cbc1-b4eb-4e74-bd6e-0988b549c668 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1210 microversion: 2.1 time: 0.082324 Aug 19 09:35:31.863058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 766/1504] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:31 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:32.846466 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-bf9fe88b-2d12-4d35-99d0-0d4c7c371fff req-916334c7-8818-49b9-b470-4d23e0d65881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aea6611c-cc66-48b2-ae6d-9ff3b886d567", "tag": "ea7a3229-b047-48f9-ba79-7f1d3cb9a52e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:35:32.849048 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:35:32.849048 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:35:32.857467 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-bf9fe88b-2d12-4d35-99d0-0d4c7c371fff req-916334c7-8818-49b9-b470-4d23e0d65881 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:32.858199 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-bf9fe88b-2d12-4d35-99d0-0d4c7c371fff req-916334c7-8818-49b9-b470-4d23e0d65881 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:32.879568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-bf9fe88b-2d12-4d35-99d0-0d4c7c371fff req-916334c7-8818-49b9-b470-4d23e0d65881 service nova] Creating event network-changed:ea7a3229-b047-48f9-ba79-7f1d3cb9a52e for instance aea6611c-cc66-48b2-ae6d-9ff3b886d567 on hv-cinder-77387 Aug 19 09:35:32.879834 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-43489b62-1803-45ca-aa7b-652e859c6a87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:32.880604 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-43489b62-1803-45ca-aa7b-652e859c6a87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:32.885823 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-bf9fe88b-2d12-4d35-99d0-0d4c7c371fff req-916334c7-8818-49b9-b470-4d23e0d65881 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042720 Aug 19 09:35:32.886512 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 739/1505] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:35:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:35:32.889525 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-43489b62-1803-45ca-aa7b-652e859c6a87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:32.889980 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-43489b62-1803-45ca-aa7b-652e859c6a87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:32.890771 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-43489b62-1803-45ca-aa7b-652e859c6a87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:32.891207 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-43489b62-1803-45ca-aa7b-652e859c6a87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:33.021582 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-43489b62-1803-45ca-aa7b-652e859c6a87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:33.029712 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-43489b62-1803-45ca-aa7b-652e859c6a87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.154541 Aug 19 09:35:33.039989 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 767/1506] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:32 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:34.047813 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-054dc949-9bb6-483c-b671-bae5ed325848 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:34.048441 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-054dc949-9bb6-483c-b671-bae5ed325848 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:34.055067 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-054dc949-9bb6-483c-b671-bae5ed325848 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:34.055532 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-054dc949-9bb6-483c-b671-bae5ed325848 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:34.056300 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-054dc949-9bb6-483c-b671-bae5ed325848 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:34.056735 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-054dc949-9bb6-483c-b671-bae5ed325848 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:34.181014 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-054dc949-9bb6-483c-b671-bae5ed325848 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:34.188393 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-054dc949-9bb6-483c-b671-bae5ed325848 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.144690 Aug 19 09:35:34.188948 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 740/1507] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:34 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:35.205013 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7373772f-caa4-433d-beb7-16a5e3673a55 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:35.205607 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7373772f-caa4-433d-beb7-16a5e3673a55 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:35.211951 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7373772f-caa4-433d-beb7-16a5e3673a55 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:35.212387 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7373772f-caa4-433d-beb7-16a5e3673a55 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:35.213148 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7373772f-caa4-433d-beb7-16a5e3673a55 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:35.213572 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7373772f-caa4-433d-beb7-16a5e3673a55 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:35.329636 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7373772f-caa4-433d-beb7-16a5e3673a55 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:35.337922 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7373772f-caa4-433d-beb7-16a5e3673a55 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.136563 Aug 19 09:35:35.338472 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 768/1508] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:35 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:36.353904 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-169cf277-d822-441f-a57b-50522ea14c98 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:36.354499 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-169cf277-d822-441f-a57b-50522ea14c98 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:36.360693 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-169cf277-d822-441f-a57b-50522ea14c98 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:36.361140 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-169cf277-d822-441f-a57b-50522ea14c98 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:36.361902 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-169cf277-d822-441f-a57b-50522ea14c98 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:36.362336 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-169cf277-d822-441f-a57b-50522ea14c98 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:36.479114 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-169cf277-d822-441f-a57b-50522ea14c98 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:36.486893 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-169cf277-d822-441f-a57b-50522ea14c98 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.136842 Aug 19 09:35:36.487480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 741/1509] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:36 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:37.504283 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-a43662de-9572-49f7-9b25-98446346c0c2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:37.504920 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-a43662de-9572-49f7-9b25-98446346c0c2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:37.511044 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a43662de-9572-49f7-9b25-98446346c0c2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:37.511521 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a43662de-9572-49f7-9b25-98446346c0c2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:37.512278 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a43662de-9572-49f7-9b25-98446346c0c2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:37.512707 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-a43662de-9572-49f7-9b25-98446346c0c2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:37.629738 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-a43662de-9572-49f7-9b25-98446346c0c2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:37.637514 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-a43662de-9572-49f7-9b25-98446346c0c2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.136924 Aug 19 09:35:37.638063 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 769/1510] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:37 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:38.653977 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0e2b6058-383a-4e24-ae91-d49b207d3618 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:38.654523 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0e2b6058-383a-4e24-ae91-d49b207d3618 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:38.660406 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0e2b6058-383a-4e24-ae91-d49b207d3618 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:38.660856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0e2b6058-383a-4e24-ae91-d49b207d3618 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:38.661636 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0e2b6058-383a-4e24-ae91-d49b207d3618 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:38.662067 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0e2b6058-383a-4e24-ae91-d49b207d3618 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:38.780734 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0e2b6058-383a-4e24-ae91-d49b207d3618 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:38.788005 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0e2b6058-383a-4e24-ae91-d49b207d3618 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.137756 Aug 19 09:35:38.789141 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 742/1511] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:38 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:39.805431 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0ab3389d-b804-4337-b538-b64780574651 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:39.806032 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0ab3389d-b804-4337-b538-b64780574651 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:39.811822 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0ab3389d-b804-4337-b538-b64780574651 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:39.812263 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0ab3389d-b804-4337-b538-b64780574651 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:39.813014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0ab3389d-b804-4337-b538-b64780574651 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:39.813449 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0ab3389d-b804-4337-b538-b64780574651 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:39.933521 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0ab3389d-b804-4337-b538-b64780574651 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:39.940575 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0ab3389d-b804-4337-b538-b64780574651 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.138757 Aug 19 09:35:39.941122 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 770/1512] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:39 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:40.957475 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d5ef74c7-a0bc-4f95-be20-0b0024e58a82 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:40.958138 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d5ef74c7-a0bc-4f95-be20-0b0024e58a82 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:40.964082 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5ef74c7-a0bc-4f95-be20-0b0024e58a82 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:40.964533 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5ef74c7-a0bc-4f95-be20-0b0024e58a82 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:40.965305 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5ef74c7-a0bc-4f95-be20-0b0024e58a82 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:40.965737 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d5ef74c7-a0bc-4f95-be20-0b0024e58a82 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:41.089401 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d5ef74c7-a0bc-4f95-be20-0b0024e58a82 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:41.096652 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d5ef74c7-a0bc-4f95-be20-0b0024e58a82 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.142826 Aug 19 09:35:41.097211 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 743/1513] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:40 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:42.113595 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-46701ec9-4bc0-466c-a587-d10aa1c59f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:42.114166 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-46701ec9-4bc0-466c-a587-d10aa1c59f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:42.120198 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-46701ec9-4bc0-466c-a587-d10aa1c59f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:42.120642 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-46701ec9-4bc0-466c-a587-d10aa1c59f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:42.121398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-46701ec9-4bc0-466c-a587-d10aa1c59f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:42.122959 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-46701ec9-4bc0-466c-a587-d10aa1c59f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:42.239662 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-46701ec9-4bc0-466c-a587-d10aa1c59f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:42.247018 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-46701ec9-4bc0-466c-a587-d10aa1c59f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.137122 Aug 19 09:35:42.247605 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 771/1514] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:42 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:43.233993 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-8e57cb86-ddb5-41a8-943d-40078ac47049 req-44642693-86c7-4614-bbec-89780644de24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea6611c-cc66-48b2-ae6d-9ff3b886d567", "name": "network-vif-plugged", "status": "completed", "tag": "ea7a3229-b047-48f9-ba79-7f1d3cb9a52e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:35:43.235558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:35:43.235558 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:35:43.242255 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-8e57cb86-ddb5-41a8-943d-40078ac47049 req-44642693-86c7-4614-bbec-89780644de24 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:43.242700 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-8e57cb86-ddb5-41a8-943d-40078ac47049 req-44642693-86c7-4614-bbec-89780644de24 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:43.253188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-8e57cb86-ddb5-41a8-943d-40078ac47049 req-44642693-86c7-4614-bbec-89780644de24 service nova] Creating event network-vif-plugged:ea7a3229-b047-48f9-ba79-7f1d3cb9a52e for instance aea6611c-cc66-48b2-ae6d-9ff3b886d567 on hv-cinder-77387 Aug 19 09:35:43.258019 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-8e57cb86-ddb5-41a8-943d-40078ac47049 req-44642693-86c7-4614-bbec-89780644de24 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083023 Aug 19 09:35:43.258729 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 744/1515] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:35:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:35:43.264093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7f28504d-e00b-428d-8ccc-ff14981793ee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:43.264854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7f28504d-e00b-428d-8ccc-ff14981793ee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:43.270565 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f28504d-e00b-428d-8ccc-ff14981793ee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:43.271005 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f28504d-e00b-428d-8ccc-ff14981793ee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:43.271791 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f28504d-e00b-428d-8ccc-ff14981793ee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:43.272222 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7f28504d-e00b-428d-8ccc-ff14981793ee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:43.395245 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7f28504d-e00b-428d-8ccc-ff14981793ee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:43.403094 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7f28504d-e00b-428d-8ccc-ff14981793ee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.142815 Aug 19 09:35:43.403599 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 772/1516] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:43 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:43.450275 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:35:43.450523 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:35:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:35:44.420846 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-bc5495e0-23da-4986-bea6-e74c601fb068 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:44.421568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-bc5495e0-23da-4986-bea6-e74c601fb068 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:44.427615 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bc5495e0-23da-4986-bea6-e74c601fb068 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:44.428058 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bc5495e0-23da-4986-bea6-e74c601fb068 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:44.428818 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bc5495e0-23da-4986-bea6-e74c601fb068 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:44.430002 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-bc5495e0-23da-4986-bea6-e74c601fb068 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:44.548366 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-bc5495e0-23da-4986-bea6-e74c601fb068 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:44.556256 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-bc5495e0-23da-4986-bea6-e74c601fb068 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1266 microversion: 2.1 time: 0.139421 Aug 19 09:35:44.556807 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 745/1517] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:44 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:45.572762 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-4350c30b-8168-4e35-b6ef-b141a38f0abf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:45.573370 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-4350c30b-8168-4e35-b6ef-b141a38f0abf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:45.579195 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4350c30b-8168-4e35-b6ef-b141a38f0abf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:45.579665 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4350c30b-8168-4e35-b6ef-b141a38f0abf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:45.580415 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4350c30b-8168-4e35-b6ef-b141a38f0abf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:45.580846 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-4350c30b-8168-4e35-b6ef-b141a38f0abf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:45.700409 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-4350c30b-8168-4e35-b6ef-b141a38f0abf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:45.707522 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-4350c30b-8168-4e35-b6ef-b141a38f0abf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1453 microversion: 2.1 time: 0.138520 Aug 19 09:35:45.708071 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 773/1518] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:45 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:45.723568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ec2949d5-8edf-452f-a258-e6f3da08373c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:35:45.724180 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ec2949d5-8edf-452f-a258-e6f3da08373c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:35:45.730653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ec2949d5-8edf-452f-a258-e6f3da08373c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:45.731101 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ec2949d5-8edf-452f-a258-e6f3da08373c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:45.731895 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ec2949d5-8edf-452f-a258-e6f3da08373c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:45.732328 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ec2949d5-8edf-452f-a258-e6f3da08373c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:45.855403 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-ec2949d5-8edf-452f-a258-e6f3da08373c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:35:45.862936 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ec2949d5-8edf-452f-a258-e6f3da08373c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1453 microversion: 2.1 time: 0.142967 Aug 19 09:35:45.863529 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 746/1519] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:35:45 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:35:47.703070 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-0218cbee-c307-47b3-a2cf-410ea48fe396 req-542b0f27-18d8-4911-ad29-90719fd3e00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aea6611c-cc66-48b2-ae6d-9ff3b886d567", "tag": "ea7a3229-b047-48f9-ba79-7f1d3cb9a52e"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:35:47.704653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:35:47.704653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:35:47.711792 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-0218cbee-c307-47b3-a2cf-410ea48fe396 req-542b0f27-18d8-4911-ad29-90719fd3e00d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:35:47.712232 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-0218cbee-c307-47b3-a2cf-410ea48fe396 req-542b0f27-18d8-4911-ad29-90719fd3e00d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:35:47.723962 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-0218cbee-c307-47b3-a2cf-410ea48fe396 req-542b0f27-18d8-4911-ad29-90719fd3e00d service nova] Creating event network-changed:ea7a3229-b047-48f9-ba79-7f1d3cb9a52e for instance aea6611c-cc66-48b2-ae6d-9ff3b886d567 on hv-cinder-77387 Aug 19 09:35:47.729494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-0218cbee-c307-47b3-a2cf-410ea48fe396 req-542b0f27-18d8-4911-ad29-90719fd3e00d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030004 Aug 19 09:35:47.730305 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 774/1520] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:35:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:37:32.980663 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:37:32.981681 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:37:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:37:54.699015 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:37:54.699695 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:37:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:38:01.760793 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7517638f-457a-4317-a9ee-48dfb3f3e383] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 19 09:38:01.764117 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-26df7b36-cafa-41bf-9853-24e5714c928f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:01.764611 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-26df7b36-cafa-41bf-9853-24e5714c928f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:01.770412 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-26df7b36-cafa-41bf-9853-24e5714c928f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:01.770862 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-26df7b36-cafa-41bf-9853-24e5714c928f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:01.771656 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-26df7b36-cafa-41bf-9853-24e5714c928f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:01.772091 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-26df7b36-cafa-41bf-9853-24e5714c928f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:01.797387 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-26df7b36-cafa-41bf-9853-24e5714c928f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Going to try to terminate instance {{(pid=107958) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:38:01.878776 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-26df7b36-cafa-41bf-9853-24e5714c928f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 204 len: 0 microversion: 2.1 time: 0.120043 Aug 19 09:38:01.879379 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 747/1521] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:38:01 2021] DELETE /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:38:01.887586 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: ERROR oslo.messaging._drivers.impl_rabbit [-] [417aa00e-8f3c-4b89-a0b4-6fd0c9e1ab49] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 19 09:38:01.891574 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e4a96dae-e3df-4386-b243-6162585f4b18 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:01.892259 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e4a96dae-e3df-4386-b243-6162585f4b18 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:01.898150 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4a96dae-e3df-4386-b243-6162585f4b18 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:01.898590 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4a96dae-e3df-4386-b243-6162585f4b18 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:01.899403 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4a96dae-e3df-4386-b243-6162585f4b18 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:01.899826 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e4a96dae-e3df-4386-b243-6162585f4b18 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:02.066267 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e4a96dae-e3df-4386-b243-6162585f4b18 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:02.073432 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e4a96dae-e3df-4386-b243-6162585f4b18 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1578 microversion: 2.1 time: 0.189358 Aug 19 09:38:02.073970 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 775/1522] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:01 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:03.090665 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-46361c54-a12d-4ff8-b14e-f75994fa2b2c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:03.091384 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-46361c54-a12d-4ff8-b14e-f75994fa2b2c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:03.108526 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-46361c54-a12d-4ff8-b14e-f75994fa2b2c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:03.108968 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-46361c54-a12d-4ff8-b14e-f75994fa2b2c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:03.109731 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-46361c54-a12d-4ff8-b14e-f75994fa2b2c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:03.110405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-46361c54-a12d-4ff8-b14e-f75994fa2b2c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:03.126284 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] [7517638f-457a-4317-a9ee-48dfb3f3e383] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 38270. Aug 19 09:38:03.230614 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-46361c54-a12d-4ff8-b14e-f75994fa2b2c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:03.238188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-46361c54-a12d-4ff8-b14e-f75994fa2b2c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1578 microversion: 2.1 time: 0.151528 Aug 19 09:38:03.238736 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 748/1523] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:03 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:04.255137 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-f6b0a281-4d52-46cd-b70c-eb39e9f0a96f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:04.255824 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-f6b0a281-4d52-46cd-b70c-eb39e9f0a96f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:04.272860 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f6b0a281-4d52-46cd-b70c-eb39e9f0a96f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:04.273316 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f6b0a281-4d52-46cd-b70c-eb39e9f0a96f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:04.274107 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f6b0a281-4d52-46cd-b70c-eb39e9f0a96f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:04.274551 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-f6b0a281-4d52-46cd-b70c-eb39e9f0a96f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:04.291528 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [-] [417aa00e-8f3c-4b89-a0b4-6fd0c9e1ab49] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 38274. Aug 19 09:38:04.348178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-f6b0a281-4d52-46cd-b70c-eb39e9f0a96f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:04.358498 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-f6b0a281-4d52-46cd-b70c-eb39e9f0a96f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1510 microversion: 2.1 time: 0.106937 Aug 19 09:38:04.359064 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 776/1524] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:04 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1510 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:04.763834 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-fd3d5a8f-5914-4be3-b747-22f0fc052ac4 req-2157808f-9888-452a-b567-954a90d1dac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea6611c-cc66-48b2-ae6d-9ff3b886d567", "name": "network-vif-deleted", "tag": "ea7a3229-b047-48f9-ba79-7f1d3cb9a52e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:38:04.765369 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:38:04.765369 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:38:04.771997 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-fd3d5a8f-5914-4be3-b747-22f0fc052ac4 req-2157808f-9888-452a-b567-954a90d1dac0 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:04.772440 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-fd3d5a8f-5914-4be3-b747-22f0fc052ac4 req-2157808f-9888-452a-b567-954a90d1dac0 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:04.784036 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-fd3d5a8f-5914-4be3-b747-22f0fc052ac4 req-2157808f-9888-452a-b567-954a90d1dac0 service nova] Creating event network-vif-deleted:ea7a3229-b047-48f9-ba79-7f1d3cb9a52e for instance aea6611c-cc66-48b2-ae6d-9ff3b886d567 on hv-cinder-77387 Aug 19 09:38:04.789539 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-fd3d5a8f-5914-4be3-b747-22f0fc052ac4 req-2157808f-9888-452a-b567-954a90d1dac0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029914 Aug 19 09:38:04.790232 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 749/1525] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:38:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:38:05.375545 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:05.376230 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:05.381990 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:05.382431 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:05.383194 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:05.383660 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:05.419024 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:05.419501 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:05.420045 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.objects.instance [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lazy-loading 'fault' on Instance uuid aea6611c-cc66-48b2-ae6d-9ff3b886d567 {{(pid=107957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 19 09:38:05.459147 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:05.467341 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-362d57c1-9b02-4f50-a160-22d62200f935 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 200 len: 1230 microversion: 2.1 time: 0.095380 Aug 19 09:38:05.467940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 777/1526] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:05 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 19 09:38:06.484476 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6649a7c8-ae84-41e5-9800-3245dc51ebaf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:06.485416 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6649a7c8-ae84-41e5-9800-3245dc51ebaf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:06.491482 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6649a7c8-ae84-41e5-9800-3245dc51ebaf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:06.491937 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6649a7c8-ae84-41e5-9800-3245dc51ebaf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:06.492694 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6649a7c8-ae84-41e5-9800-3245dc51ebaf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:06.493127 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6649a7c8-ae84-41e5-9800-3245dc51ebaf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:06.508051 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-6649a7c8-ae84-41e5-9800-3245dc51ebaf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] HTTP exception thrown: Instance aea6611c-cc66-48b2-ae6d-9ff3b886d567 could not be found. Aug 19 09:38:06.508625 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6649a7c8-ae84-41e5-9800-3245dc51ebaf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Returning 404 to user: Instance aea6611c-cc66-48b2-ae6d-9ff3b886d567 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:38:06.509430 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6649a7c8-ae84-41e5-9800-3245dc51ebaf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 404 len: 111 microversion: 2.1 time: 0.029019 Aug 19 09:38:06.509940 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 750/1527] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:06 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:38:06.555513 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1978463052", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1199316966", "security_groups": [{"name": "tempest-secgroup-smoke-1911394237"}], "block_device_mapping_v2": [{"uuid": "72d66fbf-5ad9-4fd6-87dc-c2ce44ce195c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "45b3c501-5e27-451f-bd0f-84a09e2e10a6"}]}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:38:06.654890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.network.neutron [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] validate_networks() for [('45b3c501-5e27-451f-bd0f-84a09e2e10a6', None, None, None, None, None)] {{(pid=107957) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:38:07.019407 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Flavor limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:38:07.019871 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Image limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:38:07.020346 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Flavor pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:38:07.020755 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Image pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:38:07.021162 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:38:07.030931 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:07.031417 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:07.032217 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:07.032648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:07.048109 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Getting quotas for project 6ef73bc3b1c2403f95cfd6ee506880a9. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:38:07.051961 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Getting quotas for user 4f8e509570f24d1e9bd12281b17329f8 and project 6ef73bc3b1c2403f95cfd6ee506880a9. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:38:07.111381 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Going to run 1 instances... {{(pid=107957) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:38:07.113566 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72d66fbf-5ad9-4fd6-87dc-c2ce44ce195c',volume_size=None,volume_type=None)] {{(pid=107957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:38:07.234167 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-9e5f5d91-98d1-41d1-baf7-6a1b562ce180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.682239 Aug 19 09:38:07.234799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 778/1528] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:38:06 2021] POST /compute/v2.1/servers => generated 406 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:38:07.244585 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-8038f2c1-8b39-4cd6-a9d1-d3dae09b8f74 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:07.245204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-8038f2c1-8b39-4cd6-a9d1-d3dae09b8f74 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:07.296949 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-8038f2c1-8b39-4cd6-a9d1-d3dae09b8f74 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:07.304207 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-8038f2c1-8b39-4cd6-a9d1-d3dae09b8f74 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1095 microversion: 2.1 time: 0.063225 Aug 19 09:38:07.304760 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 751/1529] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:07 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:08.320920 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-e8166605-d2b8-482a-9ee6-c01810ce7b6d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:08.321544 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-e8166605-d2b8-482a-9ee6-c01810ce7b6d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:08.328418 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e8166605-d2b8-482a-9ee6-c01810ce7b6d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:08.328867 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e8166605-d2b8-482a-9ee6-c01810ce7b6d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:08.329795 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e8166605-d2b8-482a-9ee6-c01810ce7b6d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:08.330347 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-e8166605-d2b8-482a-9ee6-c01810ce7b6d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:08.409591 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-e8166605-d2b8-482a-9ee6-c01810ce7b6d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:08.416883 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-e8166605-d2b8-482a-9ee6-c01810ce7b6d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1211 microversion: 2.1 time: 0.099670 Aug 19 09:38:08.417442 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 779/1530] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:08 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:09.434169 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-9377eb5c-0fa4-4ed0-965b-4e005fdfbda3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:09.434791 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-9377eb5c-0fa4-4ed0-965b-4e005fdfbda3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:09.440872 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9377eb5c-0fa4-4ed0-965b-4e005fdfbda3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:09.441436 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9377eb5c-0fa4-4ed0-965b-4e005fdfbda3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:09.442233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9377eb5c-0fa4-4ed0-965b-4e005fdfbda3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:09.442719 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-9377eb5c-0fa4-4ed0-965b-4e005fdfbda3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:09.495784 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-378bf429-6b2f-4f50-a3d4-54b5812ff736 req-90649e3f-835d-4b98-9258-17e97a28828f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef162aab-5b8c-4270-98f2-162c7e2982ba", "tag": "b69f5bce-c9af-4a23-9a2d-ca97fa8d047e"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:38:09.498285 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:38:09.498285 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:38:09.507523 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-378bf429-6b2f-4f50-a3d4-54b5812ff736 req-90649e3f-835d-4b98-9258-17e97a28828f service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:09.508749 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-378bf429-6b2f-4f50-a3d4-54b5812ff736 req-90649e3f-835d-4b98-9258-17e97a28828f service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:09.520364 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-378bf429-6b2f-4f50-a3d4-54b5812ff736 req-90649e3f-835d-4b98-9258-17e97a28828f service nova] Creating event network-changed:b69f5bce-c9af-4a23-9a2d-ca97fa8d047e for instance ef162aab-5b8c-4270-98f2-162c7e2982ba on hv-cinder-77387 Aug 19 09:38:09.527417 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-378bf429-6b2f-4f50-a3d4-54b5812ff736 req-90649e3f-835d-4b98-9258-17e97a28828f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036464 Aug 19 09:38:09.528624 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 780/1531] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:38:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:38:09.648761 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-9377eb5c-0fa4-4ed0-965b-4e005fdfbda3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:09.656901 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-9377eb5c-0fa4-4ed0-965b-4e005fdfbda3 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.226868 Aug 19 09:38:09.657470 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 752/1532] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:09 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:10.674117 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-7a110d9a-6727-42b8-8be2-92afe55d670b tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:10.674753 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-7a110d9a-6727-42b8-8be2-92afe55d670b tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:10.680688 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7a110d9a-6727-42b8-8be2-92afe55d670b tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:10.681136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7a110d9a-6727-42b8-8be2-92afe55d670b tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:10.681897 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7a110d9a-6727-42b8-8be2-92afe55d670b tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:10.682349 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-7a110d9a-6727-42b8-8be2-92afe55d670b tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:10.800712 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-7a110d9a-6727-42b8-8be2-92afe55d670b tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:10.808410 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-7a110d9a-6727-42b8-8be2-92afe55d670b tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.138226 Aug 19 09:38:10.808949 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 781/1533] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:10 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:11.824881 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c10bc2af-5831-413d-8d5f-3a0226fdcbba tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:11.825414 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c10bc2af-5831-413d-8d5f-3a0226fdcbba tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:11.831107 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c10bc2af-5831-413d-8d5f-3a0226fdcbba tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:11.831592 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c10bc2af-5831-413d-8d5f-3a0226fdcbba tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:11.832349 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c10bc2af-5831-413d-8d5f-3a0226fdcbba tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:11.832774 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c10bc2af-5831-413d-8d5f-3a0226fdcbba tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:11.950579 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c10bc2af-5831-413d-8d5f-3a0226fdcbba tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:11.957638 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c10bc2af-5831-413d-8d5f-3a0226fdcbba tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.136473 Aug 19 09:38:11.958190 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 753/1534] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:11 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:12.973612 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-8412c992-057c-480e-a80c-c1c3f4dd7f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:12.974213 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-8412c992-057c-480e-a80c-c1c3f4dd7f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:12.980032 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8412c992-057c-480e-a80c-c1c3f4dd7f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:12.980470 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8412c992-057c-480e-a80c-c1c3f4dd7f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:12.981224 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8412c992-057c-480e-a80c-c1c3f4dd7f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:12.981653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-8412c992-057c-480e-a80c-c1c3f4dd7f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:13.101890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-8412c992-057c-480e-a80c-c1c3f4dd7f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:13.109244 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-8412c992-057c-480e-a80c-c1c3f4dd7f0d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.139238 Aug 19 09:38:13.109793 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 782/1535] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:12 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:14.126278 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c40ae50b-e2b7-4f14-8efc-7195e367a406 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:14.126879 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c40ae50b-e2b7-4f14-8efc-7195e367a406 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:14.132701 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c40ae50b-e2b7-4f14-8efc-7195e367a406 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:14.133158 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c40ae50b-e2b7-4f14-8efc-7195e367a406 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:14.133925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c40ae50b-e2b7-4f14-8efc-7195e367a406 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:14.134361 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c40ae50b-e2b7-4f14-8efc-7195e367a406 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:14.258059 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c40ae50b-e2b7-4f14-8efc-7195e367a406 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:14.266128 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c40ae50b-e2b7-4f14-8efc-7195e367a406 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.143556 Aug 19 09:38:14.266680 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 754/1536] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:14 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:15.282802 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-fa7b0334-83b8-4efb-aa46-58d734c1da59 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:15.283430 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-fa7b0334-83b8-4efb-aa46-58d734c1da59 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:15.289645 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa7b0334-83b8-4efb-aa46-58d734c1da59 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:15.290093 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa7b0334-83b8-4efb-aa46-58d734c1da59 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:15.290867 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa7b0334-83b8-4efb-aa46-58d734c1da59 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:15.291316 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-fa7b0334-83b8-4efb-aa46-58d734c1da59 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:15.415994 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-fa7b0334-83b8-4efb-aa46-58d734c1da59 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:15.423362 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-fa7b0334-83b8-4efb-aa46-58d734c1da59 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.144312 Aug 19 09:38:15.423920 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 783/1537] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:15 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:16.440600 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-182403a0-dcc1-4a66-8c7d-4c9adf6016fe tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:16.441204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-182403a0-dcc1-4a66-8c7d-4c9adf6016fe tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:16.446925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-182403a0-dcc1-4a66-8c7d-4c9adf6016fe tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:16.447405 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-182403a0-dcc1-4a66-8c7d-4c9adf6016fe tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:16.448456 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-182403a0-dcc1-4a66-8c7d-4c9adf6016fe tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:16.448905 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-182403a0-dcc1-4a66-8c7d-4c9adf6016fe tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:16.568732 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-182403a0-dcc1-4a66-8c7d-4c9adf6016fe tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:16.575948 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-182403a0-dcc1-4a66-8c7d-4c9adf6016fe tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.139005 Aug 19 09:38:16.576513 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 755/1538] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:16 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:17.592873 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-97e63b78-ec9a-438e-840e-1c0656be7421 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:17.593473 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-97e63b78-ec9a-438e-840e-1c0656be7421 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:17.599482 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-97e63b78-ec9a-438e-840e-1c0656be7421 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:17.599940 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-97e63b78-ec9a-438e-840e-1c0656be7421 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:17.600693 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-97e63b78-ec9a-438e-840e-1c0656be7421 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:17.601123 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-97e63b78-ec9a-438e-840e-1c0656be7421 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:17.718712 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-97e63b78-ec9a-438e-840e-1c0656be7421 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:17.726589 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-97e63b78-ec9a-438e-840e-1c0656be7421 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.137208 Aug 19 09:38:17.727313 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 784/1539] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:17 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:18.744158 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-789c1699-4274-4a1f-bf5d-33758d188ff6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:18.744748 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-789c1699-4274-4a1f-bf5d-33758d188ff6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:18.751195 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-789c1699-4274-4a1f-bf5d-33758d188ff6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:18.751668 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-789c1699-4274-4a1f-bf5d-33758d188ff6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:18.752427 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-789c1699-4274-4a1f-bf5d-33758d188ff6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:18.752856 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-789c1699-4274-4a1f-bf5d-33758d188ff6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:18.870470 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-789c1699-4274-4a1f-bf5d-33758d188ff6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:18.877547 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-789c1699-4274-4a1f-bf5d-33758d188ff6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.137159 Aug 19 09:38:18.878103 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 756/1540] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:18 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:19.894014 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d30b2ee1-758e-42ee-a57e-8045323a082e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:19.894685 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d30b2ee1-758e-42ee-a57e-8045323a082e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:19.900677 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d30b2ee1-758e-42ee-a57e-8045323a082e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:19.901497 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d30b2ee1-758e-42ee-a57e-8045323a082e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:19.902265 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d30b2ee1-758e-42ee-a57e-8045323a082e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:19.902695 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d30b2ee1-758e-42ee-a57e-8045323a082e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:20.027601 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d30b2ee1-758e-42ee-a57e-8045323a082e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:20.035134 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d30b2ee1-758e-42ee-a57e-8045323a082e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.144825 Aug 19 09:38:20.041548 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 785/1541] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:19 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:20.041863 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-7558679f-f8f1-4079-ba99-6d6072f815e5 req-60ba9ea8-3aa0-432a-b499-1faa8e54e78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef162aab-5b8c-4270-98f2-162c7e2982ba", "name": "network-vif-plugged", "status": "completed", "tag": "b69f5bce-c9af-4a23-9a2d-ca97fa8d047e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:38:20.042329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:38:20.042329 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:38:20.049946 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-7558679f-f8f1-4079-ba99-6d6072f815e5 req-60ba9ea8-3aa0-432a-b499-1faa8e54e78e service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:20.050409 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-7558679f-f8f1-4079-ba99-6d6072f815e5 req-60ba9ea8-3aa0-432a-b499-1faa8e54e78e service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:20.061872 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-7558679f-f8f1-4079-ba99-6d6072f815e5 req-60ba9ea8-3aa0-432a-b499-1faa8e54e78e service nova] Creating event network-vif-plugged:b69f5bce-c9af-4a23-9a2d-ca97fa8d047e for instance ef162aab-5b8c-4270-98f2-162c7e2982ba on hv-cinder-77387 Aug 19 09:38:20.066684 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-7558679f-f8f1-4079-ba99-6d6072f815e5 req-60ba9ea8-3aa0-432a-b499-1faa8e54e78e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031020 Aug 19 09:38:20.067261 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 757/1542] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:38:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:38:21.052340 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-2fc3f505-c179-4947-9a2e-7eda4f0c39e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:21.052950 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-2fc3f505-c179-4947-9a2e-7eda4f0c39e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:21.058752 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2fc3f505-c179-4947-9a2e-7eda4f0c39e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:21.059196 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2fc3f505-c179-4947-9a2e-7eda4f0c39e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:21.060080 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2fc3f505-c179-4947-9a2e-7eda4f0c39e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:21.060618 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-2fc3f505-c179-4947-9a2e-7eda4f0c39e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:21.181527 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-2fc3f505-c179-4947-9a2e-7eda4f0c39e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:21.188821 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-2fc3f505-c179-4947-9a2e-7eda4f0c39e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1267 microversion: 2.1 time: 0.140125 Aug 19 09:38:21.189371 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 786/1543] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:21 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:22.206392 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-566d7218-a773-4ace-a588-95ec56089838 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:22.207086 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-566d7218-a773-4ace-a588-95ec56089838 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:22.213115 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-566d7218-a773-4ace-a588-95ec56089838 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:22.215584 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-566d7218-a773-4ace-a588-95ec56089838 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:22.216353 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-566d7218-a773-4ace-a588-95ec56089838 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:22.216786 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-566d7218-a773-4ace-a588-95ec56089838 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:22.389966 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-566d7218-a773-4ace-a588-95ec56089838 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:22.397152 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-566d7218-a773-4ace-a588-95ec56089838 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1454 microversion: 2.1 time: 0.194767 Aug 19 09:38:22.397704 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 758/1544] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:22 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1454 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:22.412999 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-15b505af-c42f-4e34-99c1-0a73ec3c5590 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:38:22.413602 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-15b505af-c42f-4e34-99c1-0a73ec3c5590 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:38:22.419843 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-15b505af-c42f-4e34-99c1-0a73ec3c5590 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:22.420295 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-15b505af-c42f-4e34-99c1-0a73ec3c5590 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:22.421077 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-15b505af-c42f-4e34-99c1-0a73ec3c5590 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:22.421481 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-15b505af-c42f-4e34-99c1-0a73ec3c5590 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:22.538554 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-15b505af-c42f-4e34-99c1-0a73ec3c5590 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:38:22.546660 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-15b505af-c42f-4e34-99c1-0a73ec3c5590 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1454 microversion: 2.1 time: 0.137278 Aug 19 09:38:22.547206 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 787/1545] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:38:22 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:38:24.186651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-d0237d0a-42e4-4d68-aa75-b9d91565ab3d req-7c2dd303-50ca-4d5c-a636-46d1f9250c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef162aab-5b8c-4270-98f2-162c7e2982ba", "tag": "b69f5bce-c9af-4a23-9a2d-ca97fa8d047e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:38:24.188167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:38:24.188167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:38:24.195297 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-d0237d0a-42e4-4d68-aa75-b9d91565ab3d req-7c2dd303-50ca-4d5c-a636-46d1f9250c1d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:38:24.195743 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-d0237d0a-42e4-4d68-aa75-b9d91565ab3d req-7c2dd303-50ca-4d5c-a636-46d1f9250c1d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:38:24.207039 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-d0237d0a-42e4-4d68-aa75-b9d91565ab3d req-7c2dd303-50ca-4d5c-a636-46d1f9250c1d service nova] Creating event network-changed:b69f5bce-c9af-4a23-9a2d-ca97fa8d047e for instance ef162aab-5b8c-4270-98f2-162c7e2982ba on hv-cinder-77387 Aug 19 09:38:24.212083 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-d0237d0a-42e4-4d68-aa75-b9d91565ab3d req-7c2dd303-50ca-4d5c-a636-46d1f9250c1d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084288 Aug 19 09:38:24.212667 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 759/1546] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:38:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:39:03.467646 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:39:03.468332 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:39:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:39:47.994136 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:39:47.994640 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: Thu Aug 19 09:39:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:40:23.118645 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1704994223", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1199316966", "security_groups": [{"name": "tempest-secgroup-smoke-1911394237"}], "block_device_mapping_v2": [{"uuid": "7b1a514d-7eb1-4ebb-871c-a6a7eafc0065", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "45b3c501-5e27-451f-bd0f-84a09e2e10a6"}]}} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:40:23.219142 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.network.neutron [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] validate_networks() for [('45b3c501-5e27-451f-bd0f-84a09e2e10a6', None, None, None, None, None)] {{(pid=107957) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 19 09:40:23.584145 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Flavor limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 19 09:40:23.584567 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Image limits 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 19 09:40:23.585032 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Flavor pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 19 09:40:23.585436 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Image pref 0:0:0 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 19 09:40:23.585873 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.virt.hardware [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 19 09:40:23.594434 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:23.594870 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:23.595702 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:23.596133 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:23.612398 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Getting quotas for project 6ef73bc3b1c2403f95cfd6ee506880a9. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 19 09:40:23.616339 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.quota [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Getting quotas for user 4f8e509570f24d1e9bd12281b17329f8 and project 6ef73bc3b1c2403f95cfd6ee506880a9. Resources: {'cores', 'ram', 'instances'} {{(pid=107957) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 19 09:40:23.676264 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Going to run 1 instances... {{(pid=107957) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 19 09:40:23.678326 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b1a514d-7eb1-4ebb-871c-a6a7eafc0065',volume_size=None,volume_type=None)] {{(pid=107957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 19 09:40:23.794392 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-04621ab4-791a-4afc-98f5-abf9315542bf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.680281 Aug 19 09:40:23.795031 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 788/1547] 10.222.0.32 () {60 vars in 1147 bytes} [Thu Aug 19 09:40:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 19 09:40:23.803153 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7517638f-457a-4317-a9ee-48dfb3f3e383] AMQP server on 10.222.0.32:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 19 09:40:23.807722 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-545f8d9e-bbf5-457d-acbd-416748d42d5f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:23.808546 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-545f8d9e-bbf5-457d-acbd-416748d42d5f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:23.863736 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-545f8d9e-bbf5-457d-acbd-416748d42d5f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:23.870851 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-545f8d9e-bbf5-457d-acbd-416748d42d5f tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1095 microversion: 2.1 time: 0.069618 Aug 19 09:40:23.871432 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 760/1548] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:23 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:24.887894 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c8cde6f0-2b99-4717-b005-fdeac65fcc07 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:24.888336 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c8cde6f0-2b99-4717-b005-fdeac65fcc07 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:24.939743 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c8cde6f0-2b99-4717-b005-fdeac65fcc07 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:24.945997 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c8cde6f0-2b99-4717-b005-fdeac65fcc07 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1095 microversion: 2.1 time: 0.061925 Aug 19 09:40:24.946529 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 789/1549] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:24 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1095 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:25.961415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-7b6e4ecd-6525-4241-8b4c-472721d37858 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:25.962028 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-7b6e4ecd-6525-4241-8b4c-472721d37858 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:25.997277 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] [7517638f-457a-4317-a9ee-48dfb3f3e383] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 38458. Aug 19 09:40:26.032557 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-7b6e4ecd-6525-4241-8b4c-472721d37858 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:26.039033 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-7b6e4ecd-6525-4241-8b4c-472721d37858 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1095 microversion: 2.1 time: 0.081206 Aug 19 09:40:26.039632 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 761/1550] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:25 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:27.055340 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-605f77c7-c657-4c73-b174-0eb267f9d030 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:27.055954 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-605f77c7-c657-4c73-b174-0eb267f9d030 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:27.114341 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-605f77c7-c657-4c73-b174-0eb267f9d030 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:27.120727 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-605f77c7-c657-4c73-b174-0eb267f9d030 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1095 microversion: 2.1 time: 0.069039 Aug 19 09:40:27.121275 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 790/1551] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:27 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:28.138221 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-05977396-9793-4aeb-aa6c-072035295463 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:28.138848 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-05977396-9793-4aeb-aa6c-072035295463 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:28.144966 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05977396-9793-4aeb-aa6c-072035295463 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:28.145409 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05977396-9793-4aeb-aa6c-072035295463 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:28.146169 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05977396-9793-4aeb-aa6c-072035295463 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:28.146602 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-05977396-9793-4aeb-aa6c-072035295463 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:28.205953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-05977396-9793-4aeb-aa6c-072035295463 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:28.213167 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-05977396-9793-4aeb-aa6c-072035295463 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1145 microversion: 2.1 time: 0.079433 Aug 19 09:40:28.213739 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 762/1552] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:28 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:29.230215 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-0c5a0f04-eb31-4f37-af24-d0c63b7d3444 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:29.230820 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-0c5a0f04-eb31-4f37-af24-d0c63b7d3444 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:29.236739 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c5a0f04-eb31-4f37-af24-d0c63b7d3444 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:29.237438 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c5a0f04-eb31-4f37-af24-d0c63b7d3444 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:29.238198 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c5a0f04-eb31-4f37-af24-d0c63b7d3444 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:29.238628 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-0c5a0f04-eb31-4f37-af24-d0c63b7d3444 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:29.297877 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-0c5a0f04-eb31-4f37-af24-d0c63b7d3444 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:29.305171 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-0c5a0f04-eb31-4f37-af24-d0c63b7d3444 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1211 microversion: 2.1 time: 0.079264 Aug 19 09:40:29.305729 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 791/1553] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:29 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:30.230416 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-61bd3676-616c-491c-a7e5-bb7a25d1932f req-1a6bd0df-2d65-45c1-b63c-abe6bd4e1d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd5382d-dc89-4a66-ada1-dd3b72ba29d6", "tag": "a2d97219-22b4-4606-871a-754401978946"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:40:30.232131 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:40:30.232131 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:40:30.241415 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-61bd3676-616c-491c-a7e5-bb7a25d1932f req-1a6bd0df-2d65-45c1-b63c-abe6bd4e1d06 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:30.241861 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-61bd3676-616c-491c-a7e5-bb7a25d1932f req-1a6bd0df-2d65-45c1-b63c-abe6bd4e1d06 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:30.253773 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-61bd3676-616c-491c-a7e5-bb7a25d1932f req-1a6bd0df-2d65-45c1-b63c-abe6bd4e1d06 service nova] Creating event network-changed:a2d97219-22b4-4606-871a-754401978946 for instance fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 on hv-cinder-77387 Aug 19 09:40:30.259094 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-61bd3676-616c-491c-a7e5-bb7a25d1932f req-1a6bd0df-2d65-45c1-b63c-abe6bd4e1d06 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141341 Aug 19 09:40:30.259985 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 763/1554] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:40:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:40:30.321648 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-75c06911-ce16-4432-aee6-3e80d1b7567a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:30.322632 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-75c06911-ce16-4432-aee6-3e80d1b7567a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:30.328804 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75c06911-ce16-4432-aee6-3e80d1b7567a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:30.329256 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75c06911-ce16-4432-aee6-3e80d1b7567a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:30.330033 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75c06911-ce16-4432-aee6-3e80d1b7567a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:30.330471 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-75c06911-ce16-4432-aee6-3e80d1b7567a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:30.454805 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-75c06911-ce16-4432-aee6-3e80d1b7567a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:30.462416 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-75c06911-ce16-4432-aee6-3e80d1b7567a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.144362 Aug 19 09:40:30.464203 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 792/1555] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:30 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:31.480838 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-4511862c-0642-4884-8222-d27fa4401b15 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:31.481462 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-4511862c-0642-4884-8222-d27fa4401b15 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:31.487712 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4511862c-0642-4884-8222-d27fa4401b15 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:31.488154 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4511862c-0642-4884-8222-d27fa4401b15 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:31.488907 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4511862c-0642-4884-8222-d27fa4401b15 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:31.489336 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-4511862c-0642-4884-8222-d27fa4401b15 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:31.610571 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-4511862c-0642-4884-8222-d27fa4401b15 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:31.618188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-4511862c-0642-4884-8222-d27fa4401b15 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.142014 Aug 19 09:40:31.618743 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 764/1556] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:31 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:32.635875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5bf1ff45-86a1-40ce-aac8-c98591712c0e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:32.636417 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5bf1ff45-86a1-40ce-aac8-c98591712c0e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:32.642239 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5bf1ff45-86a1-40ce-aac8-c98591712c0e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:32.642688 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5bf1ff45-86a1-40ce-aac8-c98591712c0e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:32.643478 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5bf1ff45-86a1-40ce-aac8-c98591712c0e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:32.643945 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5bf1ff45-86a1-40ce-aac8-c98591712c0e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:32.760491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5bf1ff45-86a1-40ce-aac8-c98591712c0e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:32.767779 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5bf1ff45-86a1-40ce-aac8-c98591712c0e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.136309 Aug 19 09:40:32.768329 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 793/1557] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:32 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:33.784737 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-2da54952-ee94-4e43-8b42-a3aea4950573 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:33.785280 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-2da54952-ee94-4e43-8b42-a3aea4950573 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:33.791489 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2da54952-ee94-4e43-8b42-a3aea4950573 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:33.791932 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2da54952-ee94-4e43-8b42-a3aea4950573 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:33.792680 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2da54952-ee94-4e43-8b42-a3aea4950573 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:33.793107 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-2da54952-ee94-4e43-8b42-a3aea4950573 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:33.908626 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-2da54952-ee94-4e43-8b42-a3aea4950573 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:33.915694 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-2da54952-ee94-4e43-8b42-a3aea4950573 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.134661 Aug 19 09:40:33.916952 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 765/1558] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:33 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:34.931910 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-5900888d-d690-4bb0-b6a9-138b7d3ed11c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:34.932520 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-5900888d-d690-4bb0-b6a9-138b7d3ed11c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:34.938470 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5900888d-d690-4bb0-b6a9-138b7d3ed11c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:34.938914 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5900888d-d690-4bb0-b6a9-138b7d3ed11c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:34.939706 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5900888d-d690-4bb0-b6a9-138b7d3ed11c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:34.940146 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-5900888d-d690-4bb0-b6a9-138b7d3ed11c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:35.061152 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-5900888d-d690-4bb0-b6a9-138b7d3ed11c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:35.068278 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-5900888d-d690-4bb0-b6a9-138b7d3ed11c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.140069 Aug 19 09:40:35.068829 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 794/1559] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:34 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:36.084623 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-0072dc92-6b59-4f95-a183-9c7b4ecdef12 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:36.085233 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-0072dc92-6b59-4f95-a183-9c7b4ecdef12 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:36.091453 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0072dc92-6b59-4f95-a183-9c7b4ecdef12 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:36.091895 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0072dc92-6b59-4f95-a183-9c7b4ecdef12 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:36.092651 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0072dc92-6b59-4f95-a183-9c7b4ecdef12 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:36.093079 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-0072dc92-6b59-4f95-a183-9c7b4ecdef12 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:36.208760 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-0072dc92-6b59-4f95-a183-9c7b4ecdef12 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:36.216471 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-0072dc92-6b59-4f95-a183-9c7b4ecdef12 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.135545 Aug 19 09:40:36.217027 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 766/1560] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:36 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:37.233194 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-379bd715-309d-45d0-8b52-9d1f052c4f4a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:37.233803 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-379bd715-309d-45d0-8b52-9d1f052c4f4a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:37.239854 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-379bd715-309d-45d0-8b52-9d1f052c4f4a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:37.240298 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-379bd715-309d-45d0-8b52-9d1f052c4f4a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:37.241058 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-379bd715-309d-45d0-8b52-9d1f052c4f4a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:37.241516 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-379bd715-309d-45d0-8b52-9d1f052c4f4a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:37.360161 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-379bd715-309d-45d0-8b52-9d1f052c4f4a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:37.368105 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-379bd715-309d-45d0-8b52-9d1f052c4f4a tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.138440 Aug 19 09:40:37.368890 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 795/1561] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:37 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:38.385794 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-6f45968d-bbab-4a65-9bc7-563dce2164a4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:38.386402 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-6f45968d-bbab-4a65-9bc7-563dce2164a4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:38.392325 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f45968d-bbab-4a65-9bc7-563dce2164a4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:38.392766 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f45968d-bbab-4a65-9bc7-563dce2164a4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:38.393519 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f45968d-bbab-4a65-9bc7-563dce2164a4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:38.393943 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-6f45968d-bbab-4a65-9bc7-563dce2164a4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:38.515158 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-6f45968d-bbab-4a65-9bc7-563dce2164a4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:38.522365 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-6f45968d-bbab-4a65-9bc7-563dce2164a4 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.140772 Aug 19 09:40:38.522915 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 767/1562] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:38 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:39.539629 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-b9031dee-bcd0-4b14-8825-11f7716b8805 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:39.540193 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-b9031dee-bcd0-4b14-8825-11f7716b8805 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:39.546517 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b9031dee-bcd0-4b14-8825-11f7716b8805 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:39.546961 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b9031dee-bcd0-4b14-8825-11f7716b8805 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:39.547743 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b9031dee-bcd0-4b14-8825-11f7716b8805 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:39.548178 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-b9031dee-bcd0-4b14-8825-11f7716b8805 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:39.664876 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-b9031dee-bcd0-4b14-8825-11f7716b8805 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:39.672604 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-b9031dee-bcd0-4b14-8825-11f7716b8805 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.136756 Aug 19 09:40:39.673159 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 796/1563] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:39 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:40.689568 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-c7aa3fef-6880-4b7f-8fd5-22fff905cbd6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:40.690189 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-c7aa3fef-6880-4b7f-8fd5-22fff905cbd6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:40.696002 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c7aa3fef-6880-4b7f-8fd5-22fff905cbd6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:40.696480 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c7aa3fef-6880-4b7f-8fd5-22fff905cbd6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:40.697998 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c7aa3fef-6880-4b7f-8fd5-22fff905cbd6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:40.698435 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-c7aa3fef-6880-4b7f-8fd5-22fff905cbd6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:40.745019 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [req-49617e86-d184-4e71-8047-f37920733dc9 req-0fc12613-7801-4a11-8213-51340828d646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd5382d-dc89-4a66-ada1-dd3b72ba29d6", "name": "network-vif-plugged", "status": "completed", "tag": "a2d97219-22b4-4606-871a-754401978946"}]} {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:40:40.747499 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:40:40.747499 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: warnings.warn(msg) Aug 19 09:40:40.755718 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-49617e86-d184-4e71-8047-f37920733dc9 req-0fc12613-7801-4a11-8213-51340828d646 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:40.756315 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [req-49617e86-d184-4e71-8047-f37920733dc9 req-0fc12613-7801-4a11-8213-51340828d646 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:40.768768 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.compute.server_external_events [req-49617e86-d184-4e71-8047-f37920733dc9 req-0fc12613-7801-4a11-8213-51340828d646 service nova] Creating event network-vif-plugged:a2d97219-22b4-4606-871a-754401978946 for instance fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 on hv-cinder-77387 Aug 19 09:40:40.773992 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [req-49617e86-d184-4e71-8047-f37920733dc9 req-0fc12613-7801-4a11-8213-51340828d646 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033721 Aug 19 09:40:40.774665 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 797/1564] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:40:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:40:40.826804 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-c7aa3fef-6880-4b7f-8fd5-22fff905cbd6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:40.834902 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-c7aa3fef-6880-4b7f-8fd5-22fff905cbd6 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.149049 Aug 19 09:40:40.835491 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 768/1565] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:40 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:41.851875 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ad0c6f82-c302-4a63-b8ae-5ae1e6e634a2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:41.852498 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-ad0c6f82-c302-4a63-b8ae-5ae1e6e634a2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:41.858538 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ad0c6f82-c302-4a63-b8ae-5ae1e6e634a2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:41.858988 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ad0c6f82-c302-4a63-b8ae-5ae1e6e634a2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:41.859774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ad0c6f82-c302-4a63-b8ae-5ae1e6e634a2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:41.860210 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-ad0c6f82-c302-4a63-b8ae-5ae1e6e634a2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:41.983774 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-ad0c6f82-c302-4a63-b8ae-5ae1e6e634a2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:41.991160 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ad0c6f82-c302-4a63-b8ae-5ae1e6e634a2 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1267 microversion: 2.1 time: 0.143369 Aug 19 09:40:41.991739 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 798/1566] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:41 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:43.007703 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-141c8a47-a0ff-4148-86b5-0364218b85fa tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:43.008335 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-141c8a47-a0ff-4148-86b5-0364218b85fa tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:43.014147 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-141c8a47-a0ff-4148-86b5-0364218b85fa tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:43.014587 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-141c8a47-a0ff-4148-86b5-0364218b85fa tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:43.015356 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-141c8a47-a0ff-4148-86b5-0364218b85fa tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:43.015787 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-141c8a47-a0ff-4148-86b5-0364218b85fa tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:43.135949 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-141c8a47-a0ff-4148-86b5-0364218b85fa tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:43.143056 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-141c8a47-a0ff-4148-86b5-0364218b85fa tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1454 microversion: 2.1 time: 0.138986 Aug 19 09:40:43.143631 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 769/1567] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:43 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:43.158945 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-40bdf393-0bca-41e7-9ab6-2009d13a5ddf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:40:43.159865 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-40bdf393-0bca-41e7-9ab6-2009d13a5ddf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:40:43.165452 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-40bdf393-0bca-41e7-9ab6-2009d13a5ddf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:43.166519 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-40bdf393-0bca-41e7-9ab6-2009d13a5ddf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:43.167280 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-40bdf393-0bca-41e7-9ab6-2009d13a5ddf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:43.167720 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-40bdf393-0bca-41e7-9ab6-2009d13a5ddf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:43.284958 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-40bdf393-0bca-41e7-9ab6-2009d13a5ddf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:40:43.292380 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-40bdf393-0bca-41e7-9ab6-2009d13a5ddf tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1454 microversion: 2.1 time: 0.136997 Aug 19 09:40:43.292931 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 799/1568] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:40:43 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:40:45.128228 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-2e51dfe9-1987-4cdf-a5e1-bf48a1414d28 req-082919c2-177e-410e-85dc-00e441908e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd5382d-dc89-4a66-ada1-dd3b72ba29d6", "tag": "a2d97219-22b4-4606-871a-754401978946"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:40:45.129694 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:40:45.129694 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:40:45.137370 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-2e51dfe9-1987-4cdf-a5e1-bf48a1414d28 req-082919c2-177e-410e-85dc-00e441908e6a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:40:45.137808 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-2e51dfe9-1987-4cdf-a5e1-bf48a1414d28 req-082919c2-177e-410e-85dc-00e441908e6a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:40:45.148655 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-2e51dfe9-1987-4cdf-a5e1-bf48a1414d28 req-082919c2-177e-410e-85dc-00e441908e6a service nova] Creating event network-changed:a2d97219-22b4-4606-871a-754401978946 for instance fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 on hv-cinder-77387 Aug 19 09:40:45.154240 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-2e51dfe9-1987-4cdf-a5e1-bf48a1414d28 req-082919c2-177e-410e-85dc-00e441908e6a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029551 Aug 19 09:40:45.154901 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 770/1569] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:40:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:40:52.999967 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:40:53.000674 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:40:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:42:23.485334 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:42:23.485919 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:42:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:42:34.930710 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7517638f-457a-4317-a9ee-48dfb3f3e383] AMQP server on 10.222.0.32:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 19 09:42:34.931491 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: ERROR oslo.messaging._drivers.impl_rabbit [-] [417aa00e-8f3c-4b89-a0b4-6fd0c9e1ab49] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 19 09:42:34.934533 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-250e778c-17ec-444e-86ae-23ee09ecf13e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:34.935224 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-250e778c-17ec-444e-86ae-23ee09ecf13e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:34.935864 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-7e22aac3-4dd8-49f1-a08c-0082f536df6e req-d57ba118-be44-4f91-9daf-962e41dd19d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd5382d-dc89-4a66-ada1-dd3b72ba29d6", "tag": "a2d97219-22b4-4606-871a-754401978946"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:42:34.937317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:42:34.937317 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:42:34.941203 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-250e778c-17ec-444e-86ae-23ee09ecf13e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:34.941653 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-250e778c-17ec-444e-86ae-23ee09ecf13e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:34.942424 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-250e778c-17ec-444e-86ae-23ee09ecf13e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:34.942853 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-250e778c-17ec-444e-86ae-23ee09ecf13e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:34.944761 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-7e22aac3-4dd8-49f1-a08c-0082f536df6e req-d57ba118-be44-4f91-9daf-962e41dd19d6 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:34.945204 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-7e22aac3-4dd8-49f1-a08c-0082f536df6e req-d57ba118-be44-4f91-9daf-962e41dd19d6 service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:34.957839 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-7e22aac3-4dd8-49f1-a08c-0082f536df6e req-d57ba118-be44-4f91-9daf-962e41dd19d6 service nova] Creating event network-changed:a2d97219-22b4-4606-871a-754401978946 for instance fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 on hv-cinder-77387 Aug 19 09:42:34.963198 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-7e22aac3-4dd8-49f1-a08c-0082f536df6e req-d57ba118-be44-4f91-9daf-962e41dd19d6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 Aug 19 09:42:34.964547 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 771/1570] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:42:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 19 09:42:34.969883 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-250e778c-17ec-444e-86ae-23ee09ecf13e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Going to try to terminate instance {{(pid=107957) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:42:35.050963 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-250e778c-17ec-444e-86ae-23ee09ecf13e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 204 len: 0 microversion: 2.1 time: 0.125023 Aug 19 09:42:35.051738 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 800/1571] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:42:34 2021] DELETE /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:42:35.061188 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-d8594c13-ed94-4c47-9041-735b54184074 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:35.062100 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-d8594c13-ed94-4c47-9041-735b54184074 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:35.068351 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d8594c13-ed94-4c47-9041-735b54184074 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:35.068889 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d8594c13-ed94-4c47-9041-735b54184074 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:35.069941 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d8594c13-ed94-4c47-9041-735b54184074 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:35.070452 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-d8594c13-ed94-4c47-9041-735b54184074 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:35.265146 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-d8594c13-ed94-4c47-9041-735b54184074 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:42:35.272544 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-d8594c13-ed94-4c47-9041-735b54184074 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1578 microversion: 2.1 time: 0.215875 Aug 19 09:42:35.273313 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 772/1572] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:42:35 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:42:36.290706 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-86f0ac8e-f90d-480d-a447-83b4f51bcb44 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:36.291346 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-86f0ac8e-f90d-480d-a447-83b4f51bcb44 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:36.308192 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-86f0ac8e-f90d-480d-a447-83b4f51bcb44 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:36.308633 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-86f0ac8e-f90d-480d-a447-83b4f51bcb44 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:36.309391 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-86f0ac8e-f90d-480d-a447-83b4f51bcb44 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:36.309819 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-86f0ac8e-f90d-480d-a447-83b4f51bcb44 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:36.315443 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [-] [417aa00e-8f3c-4b89-a0b4-6fd0c9e1ab49] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 38574. Aug 19 09:42:36.435683 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-86f0ac8e-f90d-480d-a447-83b4f51bcb44 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:42:36.442804 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-86f0ac8e-f90d-480d-a447-83b4f51bcb44 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1460 microversion: 2.1 time: 0.156241 Aug 19 09:42:36.443370 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 801/1573] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:42:36 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1460 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:42:37.339653 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-fbf72eee-ed87-451f-a692-99583b89fc38 req-78c321cc-941a-4584-840a-e41ce92f589a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd5382d-dc89-4a66-ada1-dd3b72ba29d6", "name": "network-vif-deleted", "tag": "a2d97219-22b4-4606-871a-754401978946"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:42:37.341139 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:42:37.341139 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:42:37.359507 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-fbf72eee-ed87-451f-a692-99583b89fc38 req-78c321cc-941a-4584-840a-e41ce92f589a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:37.359951 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-fbf72eee-ed87-451f-a692-99583b89fc38 req-78c321cc-941a-4584-840a-e41ce92f589a service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:37.372577 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-fbf72eee-ed87-451f-a692-99583b89fc38 req-78c321cc-941a-4584-840a-e41ce92f589a service nova] Creating event network-vif-deleted:a2d97219-22b4-4606-871a-754401978946 for instance fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 on hv-cinder-77387 Aug 19 09:42:37.377508 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-fbf72eee-ed87-451f-a692-99583b89fc38 req-78c321cc-941a-4584-840a-e41ce92f589a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041548 Aug 19 09:42:37.378087 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 773/1574] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:42:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:42:37.460382 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-c4019908-f915-4554-89aa-7b47603a857c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:37.460993 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-c4019908-f915-4554-89aa-7b47603a857c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:37.467074 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c4019908-f915-4554-89aa-7b47603a857c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:37.467554 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c4019908-f915-4554-89aa-7b47603a857c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:37.468317 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c4019908-f915-4554-89aa-7b47603a857c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:37.468751 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-c4019908-f915-4554-89aa-7b47603a857c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:37.527096 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-c4019908-f915-4554-89aa-7b47603a857c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:42:37.534251 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-c4019908-f915-4554-89aa-7b47603a857c tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 200 len: 1226 microversion: 2.1 time: 0.077592 Aug 19 09:42:37.534799 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 802/1575] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:42:37 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:42:38.551982 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cbdac21c-fc02-44e2-afe2-e5d37a224180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:38.552583 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-cbdac21c-fc02-44e2-afe2-e5d37a224180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: fcd5382d-dc89-4a66-ada1-dd3b72ba29d6] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:38.554665 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] [7517638f-457a-4317-a9ee-48dfb3f3e383] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 38578. Aug 19 09:42:38.559926 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cbdac21c-fc02-44e2-afe2-e5d37a224180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:38.560367 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cbdac21c-fc02-44e2-afe2-e5d37a224180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:38.561127 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cbdac21c-fc02-44e2-afe2-e5d37a224180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:38.561552 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-cbdac21c-fc02-44e2-afe2-e5d37a224180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:38.576068 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-cbdac21c-fc02-44e2-afe2-e5d37a224180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] HTTP exception thrown: Instance fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 could not be found. Aug 19 09:42:38.576642 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-cbdac21c-fc02-44e2-afe2-e5d37a224180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Returning 404 to user: Instance fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:42:38.577443 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-cbdac21c-fc02-44e2-afe2-e5d37a224180 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6" status: 404 len: 111 microversion: 2.1 time: 0.029592 Aug 19 09:42:38.577953 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 774/1576] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:42:38 2021] GET /compute/v2.1/servers/fcd5382d-dc89-4a66-ada1-dd3b72ba29d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:42:41.627564 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-20baeecf-8055-4d1d-9df1-a9a02c6868e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:41.628073 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-20baeecf-8055-4d1d-9df1-a9a02c6868e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:41.630716 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-628d6384-0fc9-4ab3-92e1-0b0ca8e15a02 req-16575680-d74d-4ae4-a75d-e20ef2e46f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef162aab-5b8c-4270-98f2-162c7e2982ba", "tag": "b69f5bce-c9af-4a23-9a2d-ca97fa8d047e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:42:41.632260 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:42:41.632260 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:42:41.635065 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-20baeecf-8055-4d1d-9df1-a9a02c6868e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:41.635545 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-20baeecf-8055-4d1d-9df1-a9a02c6868e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:41.636316 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-20baeecf-8055-4d1d-9df1-a9a02c6868e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:41.636754 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-20baeecf-8055-4d1d-9df1-a9a02c6868e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:41.640578 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-628d6384-0fc9-4ab3-92e1-0b0ca8e15a02 req-16575680-d74d-4ae4-a75d-e20ef2e46f4d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:41.641094 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-628d6384-0fc9-4ab3-92e1-0b0ca8e15a02 req-16575680-d74d-4ae4-a75d-e20ef2e46f4d service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:41.652621 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-628d6384-0fc9-4ab3-92e1-0b0ca8e15a02 req-16575680-d74d-4ae4-a75d-e20ef2e46f4d service nova] Creating event network-changed:b69f5bce-c9af-4a23-9a2d-ca97fa8d047e for instance ef162aab-5b8c-4270-98f2-162c7e2982ba on hv-cinder-77387 Aug 19 09:42:41.658230 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-628d6384-0fc9-4ab3-92e1-0b0ca8e15a02 req-16575680-d74d-4ae4-a75d-e20ef2e46f4d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031150 Aug 19 09:42:41.659080 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 775/1577] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:42:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:42:41.663078 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-20baeecf-8055-4d1d-9df1-a9a02c6868e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Going to try to terminate instance {{(pid=107957) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 19 09:42:41.746077 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-20baeecf-8055-4d1d-9df1-a9a02c6868e5 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 204 len: 0 microversion: 2.1 time: 0.121772 Aug 19 09:42:41.746654 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 803/1578] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:42:41 2021] DELETE /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 19 09:42:41.756096 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-19d05ab9-c745-4da6-8c75-8090c96b7dee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:41.756811 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-19d05ab9-c745-4da6-8c75-8090c96b7dee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:41.763801 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19d05ab9-c745-4da6-8c75-8090c96b7dee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:41.764242 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19d05ab9-c745-4da6-8c75-8090c96b7dee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:41.765007 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19d05ab9-c745-4da6-8c75-8090c96b7dee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:41.765435 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-19d05ab9-c745-4da6-8c75-8090c96b7dee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:41.996730 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.policy [None req-19d05ab9-c745-4da6-8c75-8090c96b7dee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107958) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:42:42.005473 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-19d05ab9-c745-4da6-8c75-8090c96b7dee tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1578 microversion: 2.1 time: 0.253858 Aug 19 09:42:42.013222 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 776/1579] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:42:41 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1578 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:42:43.024117 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-6a470067-0568-4b21-a3a8-6bc105425f21 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:43.024811 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-6a470067-0568-4b21-a3a8-6bc105425f21 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:43.030561 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a470067-0568-4b21-a3a8-6bc105425f21 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:43.031000 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a470067-0568-4b21-a3a8-6bc105425f21 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:43.031791 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a470067-0568-4b21-a3a8-6bc105425f21 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:43.032219 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-6a470067-0568-4b21-a3a8-6bc105425f21 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:43.154915 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-6a470067-0568-4b21-a3a8-6bc105425f21 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:42:43.163625 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-6a470067-0568-4b21-a3a8-6bc105425f21 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1460 microversion: 2.1 time: 0.143617 Aug 19 09:42:43.164188 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 804/1580] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:42:43 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1460 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:42:43.981350 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [req-50af7bec-12b8-4a80-9b3f-9d29a9d84812 req-b2ff230c-230b-42b0-909c-dd952d59bddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef162aab-5b8c-4270-98f2-162c7e2982ba", "name": "network-vif-deleted", "tag": "b69f5bce-c9af-4a23-9a2d-ca97fa8d047e"}]} {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 19 09:42:43.982881 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 09:42:43.982881 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: warnings.warn(msg) Aug 19 09:42:43.989925 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-50af7bec-12b8-4a80-9b3f-9d29a9d84812 req-b2ff230c-230b-42b0-909c-dd952d59bddd service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:43.990364 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [req-50af7bec-12b8-4a80-9b3f-9d29a9d84812 req-b2ff230c-230b-42b0-909c-dd952d59bddd service nova] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:44.002609 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.compute.server_external_events [req-50af7bec-12b8-4a80-9b3f-9d29a9d84812 req-b2ff230c-230b-42b0-909c-dd952d59bddd service nova] Creating event network-vif-deleted:b69f5bce-c9af-4a23-9a2d-ca97fa8d047e for instance ef162aab-5b8c-4270-98f2-162c7e2982ba on hv-cinder-77387 Aug 19 09:42:44.010116 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [req-50af7bec-12b8-4a80-9b3f-9d29a9d84812 req-b2ff230c-230b-42b0-909c-dd952d59bddd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032259 Aug 19 09:42:44.010705 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 777/1581] 10.222.0.32 () {64 vars in 1318 bytes} [Thu Aug 19 09:42:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 19 09:42:44.181140 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-d5513532-a083-4908-b264-9200ca4b0f87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:44.181719 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-d5513532-a083-4908-b264-9200ca4b0f87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:44.187469 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5513532-a083-4908-b264-9200ca4b0f87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:44.187916 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5513532-a083-4908-b264-9200ca4b0f87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:44.188936 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5513532-a083-4908-b264-9200ca4b0f87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:44.189367 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-d5513532-a083-4908-b264-9200ca4b0f87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:44.249390 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.policy [None req-d5513532-a083-4908-b264-9200ca4b0f87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e509570f24d1e9bd12281b17329f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef73bc3b1c2403f95cfd6ee506880a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107957) authorize /opt/stack/nova/nova/policy.py:199}} Aug 19 09:42:44.257933 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-d5513532-a083-4908-b264-9200ca4b0f87 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 200 len: 1226 microversion: 2.1 time: 0.081213 Aug 19 09:42:44.259212 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 805/1582] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:42:44 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 19 09:42:45.275769 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ee89c166-be3d-4064-8ac9-8a1b77efb694 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:45.276465 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-ee89c166-be3d-4064-8ac9-8a1b77efb694 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: ef162aab-5b8c-4270-98f2-162c7e2982ba] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:45.282474 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee89c166-be3d-4064-8ac9-8a1b77efb694 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:45.282923 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee89c166-be3d-4064-8ac9-8a1b77efb694 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:45.283711 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee89c166-be3d-4064-8ac9-8a1b77efb694 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:45.284148 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-ee89c166-be3d-4064-8ac9-8a1b77efb694 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:45.296984 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-ee89c166-be3d-4064-8ac9-8a1b77efb694 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] HTTP exception thrown: Instance ef162aab-5b8c-4270-98f2-162c7e2982ba could not be found. Aug 19 09:42:45.297561 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-ee89c166-be3d-4064-8ac9-8a1b77efb694 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Returning 404 to user: Instance ef162aab-5b8c-4270-98f2-162c7e2982ba could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:42:45.298372 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-ee89c166-be3d-4064-8ac9-8a1b77efb694 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba" status: 404 len: 111 microversion: 2.1 time: 0.026951 Aug 19 09:42:45.298886 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 778/1583] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:42:45 2021] GET /compute/v2.1/servers/ef162aab-5b8c-4270-98f2-162c7e2982ba => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:42:45.737977 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-964c5ba9-0e7c-402b-9c2d-e3e8294bdf70 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:45.738777 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.compute.api [None req-964c5ba9-0e7c-402b-9c2d-e3e8294bdf70 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107957) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:45.745294 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-964c5ba9-0e7c-402b-9c2d-e3e8294bdf70 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:45.745737 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-964c5ba9-0e7c-402b-9c2d-e3e8294bdf70 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:45.746494 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-964c5ba9-0e7c-402b-9c2d-e3e8294bdf70 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:45.746922 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG oslo_concurrency.lockutils [None req-964c5ba9-0e7c-402b-9c2d-e3e8294bdf70 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:45.761630 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.wsgi [None req-964c5ba9-0e7c-402b-9c2d-e3e8294bdf70 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] HTTP exception thrown: Instance aea6611c-cc66-48b2-ae6d-9ff3b886d567 could not be found. Aug 19 09:42:45.762154 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-964c5ba9-0e7c-402b-9c2d-e3e8294bdf70 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Returning 404 to user: Instance aea6611c-cc66-48b2-ae6d-9ff3b886d567 could not be found. {{(pid=107957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:42:45.762950 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-964c5ba9-0e7c-402b-9c2d-e3e8294bdf70 tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 404 len: 111 microversion: 2.1 time: 0.028660 Aug 19 09:42:45.763487 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 806/1584] 10.222.0.32 () {58 vars in 1239 bytes} [Thu Aug 19 09:42:45 2021] DELETE /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:42:45.771530 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-af889e45-a7ef-46e2-9a5d-592fcf3e1a5d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '>' {{(pid=107958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:45.772137 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.compute.api [None req-af889e45-a7ef-46e2-9a5d-592fcf3e1a5d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] [instance: aea6611c-cc66-48b2-ae6d-9ff3b886d567] Fetching instance by UUID {{(pid=107958) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 19 09:42:45.778798 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af889e45-a7ef-46e2-9a5d-592fcf3e1a5d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:45.779237 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af889e45-a7ef-46e2-9a5d-592fcf3e1a5d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:45.780031 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af889e45-a7ef-46e2-9a5d-592fcf3e1a5d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 19 09:42:45.780486 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG oslo_concurrency.lockutils [None req-af889e45-a7ef-46e2-9a5d-592fcf3e1a5d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Lock "56a64298-a3a4-4bdc-9512-dd1b74decc78" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 19 09:42:45.793934 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.wsgi [None req-af889e45-a7ef-46e2-9a5d-592fcf3e1a5d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] HTTP exception thrown: Instance aea6611c-cc66-48b2-ae6d-9ff3b886d567 could not be found. Aug 19 09:42:45.794542 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: DEBUG nova.api.openstack.wsgi [None req-af889e45-a7ef-46e2-9a5d-592fcf3e1a5d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Returning 404 to user: Instance aea6611c-cc66-48b2-ae6d-9ff3b886d567 could not be found. {{(pid=107958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 19 09:42:45.795389 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO nova.api.openstack.requestlog [None req-af889e45-a7ef-46e2-9a5d-592fcf3e1a5d tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567" status: 404 len: 111 microversion: 2.1 time: 0.027731 Aug 19 09:42:45.795894 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: [pid: 107958|app: 0|req: 779/1585] 10.222.0.32 () {58 vars in 1236 bytes} [Thu Aug 19 09:42:45 2021] GET /compute/v2.1/servers/aea6611c-cc66-48b2-ae6d-9ff3b886d567 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 19 09:42:47.074543 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: DEBUG nova.api.openstack.wsgi [None req-ecccabf6-1b4a-470a-a8a5-f068e2ecad2e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] Calling method '.version_select at 0x7fdb803a9940>' {{(pid=107957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 19 09:42:47.095072 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO nova.api.openstack.requestlog [None req-ecccabf6-1b4a-470a-a8a5-f068e2ecad2e tempest-TestVolumeBootPattern-121486158 tempest-TestVolumeBootPattern-121486158-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1199316966" status: 202 len: 0 microversion: 2.1 time: 0.024468 Aug 19 09:42:47.095680 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: [pid: 107957|app: 0|req: 807/1586] 10.222.0.32 () {58 vars in 1263 bytes} [Thu Aug 19 09:42:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1199316966 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 19 09:44:13.017443 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:44:13.018014 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:44:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:44:48.013433 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:44:48.014176 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: Thu Aug 19 09:44:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:45:43.503727 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:45:43.504244 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:45:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:45:45.903846 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:45:45.904435 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: Thu Aug 19 09:45:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:47:33.035498 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:47:33.038476 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:47:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:47:54.723477 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:47:54.724155 dv-cinder-773876-3-iscsi devstack@n-api.service[107958]: Thu Aug 19 09:47:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:47:56.814186 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:47:56.814722 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: Thu Aug 19 09:47:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 19 09:48:08.030961 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 19 09:48:08.031678 dv-cinder-773876-3-iscsi devstack@n-api.service[107957]: Thu Aug 19 09:48:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!